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ABSTRACT 

The marginal utility of the Turing machine computational resources 
running time and storage space are studied. A technique is developed 
which, unlike diagonalization, applies equally well to nondeterministic 
and deterministic automata. For f , g time or space bounding functions 
with f(n+l) small compared to g(n) , it is shown that, in terms of word 
length n, there are languages which are accepted by Turing machines 
operating within time or space g(n) but which are accepted by no Turing 
machine operating within time or space f(n). The proof involves use of 
the recursion theorem together with "padding" or "translational" tech- 
niques of formal language theory. 

Relations between worktape alphabet size, number of worktape heads, 
number of input heads, and Turing machine storage space are established. 
Within every common subexponential space bound, it is shown that enlarg- 
ing the worktape alphabet always increases computing power. A hierarchy 
of two-way multihead finite automata is obtained even in the nondetermi- 
nistic case. 

Results that are only slightly weaker are obtained for Turing 
machines that accept only languages over a one-letter alphabet. 
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CHAPTER ONE 
INTRODUCTION 

The ultimate purpose of studies in computational complexity is to 
establish the complexity, in terms of computational resources such as 
time and storage space, that is inherent in particular computational 
tasks. The existence of computational tasks with various inherent com- 
plexities is the subject of this thesis. The mere existence of such 
computational tasks does not, a priori , have a bearing on the complexity 
of computational tasks of practical interest; but in fact techniques 
such as those of Meyer and Stockmeyer {MS72], Meyer [Mey73] , Stockmeyer 
and Meyer [SM73], Hunt [Hun73] , M. Fischer and Rabin [FR74] , and 
Stockmeyer [St74] sometimes show that a particular task of interest lies 
at some level if anything does, and results like ours can then serve. 

The computational tasks that we consider are "language acceptance" 
tasks. A language is a set of strings of symbols from some finite 
alphabet. A language is accepted by a computer M if M enters an accept- 
ing state when and only when applied to a member of the language. We 
denote by L(M) the language accepted by M. 

Turing machines are the computer model we use. Customarily, we 
measure time and space usage by a Turing acceptor in terms of input 
length only. (We denote by | x| the length of the string x.) The Turing 
machine M accepts L(M) within time T(n) or space S(n) if each string 
x € L(M) is accepted in some computation involving no more than T(| xj ) 
steps or S(|xj) worktape squares, respectively. (More precise defini- 
tions appear in Chapters Two and Three.) We denote by NTIME(T) and 



DTIME(T) the classes of languages- accepted within time T by nondetermi- 
nistic and deterministic Turing machines, respectively; and we denote by 
NSPACE(S) and DSPACE(S) the classes of languages accepted within space S 
by nondeterministic and deterministic Turing machines, respectively. 

We would like, for example, to define the inherent deterministic 
time complexity of accepting a language L to be the "least" time bound T, 
in some sense, such that L € DTIME(T) . The existence of languages which 
have no best acceptor (languages with "speed-up" [Blm67D , however, 
makes such an approach impossible. Instead, we content ourselves to 
specify pairs of time bounds T^ T 2 for which L € DTIME<T 2 ) - DTIME^). 
In effect, then, we are led to a study of the containment lattice of the 
complexity classes. For example we address ourselves to the problems of 
finding what we call "containment" and "separation" conditions on time 
bounds T , T 2 which imply that DTIME^) c DTIME(T 2 ) and that 
DTIME(T 2 ) - DTIllKT^y <t> d- e. , DTME(T 2 ) <t DTIME^)) , respectively. 

Rather strong separation results for the DTBffi and DSPACE complexity 
classes are well known ([HaS65], [HeS66] , [SHL65] , [HD69a] , [HU69b], 
[Con73], Appendix I of this thesis), but the diagonalization technique 
that most of them rely on does not give very strong separation results 
for the NTIME and NSPACE classes. A result of Cook [Ck73] first sepa- 
rated NTIME(n r ) from NTIME(n 8 ) for r ^ s. Our contribution is a simpli- 
fied and greatly generalized version of Cook's technique that applies to 
nondeterministic and deterministic time and space complexity. 

The major value of our technique is for nondeterministic computa- 
tion, and the results are most dramatic at exponential and subexponential 



complexity levels. Although no real computer actually operates nonde- 
terministically, the concept does arise naturally in connection with 
formal language theory ([HU69b], [AU72], {AU73]), proof theory, and the 
description and complexity of other processes involving arbitrary 
searches [F167]. (A deterministic description would force one to specify 
the essentially irrelevant details of some arbitrary search algorithm.) 
The Cook-Karp question of whether P = NP, where 

P =U {DTIME(T)| T is a polynomial time bound}, 

NP =U {NTIME(T)| T is a polynomial time bound}, 
represents a mathematical formulation of the problem of characterizing 
the complexity of a large class of combinatorial optimization problems 
involving such unstructured searches ([Ck71] , [Krp72]). 

We first generalize Cook's technique for multitape Turing machine 
time complexity in Chapter Two. For well-behaved T 2> we show that 
NTIME(T 2 ) - NTIMECT.) ji <j> whenever T (n+1) € o<T 2 (n)),"'' for example. 
Surprisingly, this yields some specific separation results for NTIME 
which are stronger than the corresponding known separation results for 
DTIME. In contrast, the earlier results based on diagonalization were 
always stronger for DTIME than for NTIME. Separation results with re- 
spect to languages over a one- letter alphabet are obtained that are only 
slightly weaker than the general ones. 

In Chapter Three we refine the NSPACE and DSPACE complexity classes 

For g a nonnegative real -valued function on N (the set of all non- 
negative integers) , we use the notation o(g) (0(g) , respectively) for 
the class of all nonnegative real-valued functions f on N that satisfy 
lim (f(n)/g(n)) = (lim sup (f(n)/g(n)) < », respectively) as n tends 
to infinity. 
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by carefully bounding worktape alphabet size and number of work tape 
heads. We reformulate the known separation results for these classes 
and apply our technique to get new ones of the. kind given above for 
NTIME. By relating the various resources (space, worktape alphabet size, 
number of worktape heads), we obtain separation results that focus on 
the marginal utility of each resource. As a corollary we get a hierar- 
chy theorem for two-way multihead finite automata. As in Chapter Two, 
only slightly weaker separation results axe obtained with respect to 
languages over a one- letter alphabet. 

A preliminary version of this thesis has been reported jointly with 
M. Fischer and A. Meyer [SFt§?3]. In particulate, Corollaries 14, 16 of 
Chapter Two were obtained and reported jointly. Chapter Three contains 
much new material, but Corollaries -.19(111) , 20(111) , 22 were also pre- 
sented in the preliminary version. Problems 2, 3, 4 of [SFM73] are set- 
tled affirmatively by the current results of Chapters Two and Three. 

For convenient reference we now list the results which are the main 
contributions of this thesis. All of the relevant definitions and nota- 
tion are provided in Chapters Two and Three. 

Chapter Two 

Assume T. is a running time. 

The most general result we prove is Theorem 13. 
Theorem 13 . 

NTIME(T 2 ) - |J {NTIME(T 1 ) | there is some recursively bounded but strictly 

increasing function f:N -» N for which 
T x (f(n+1)) € o(T 2 (f(n)))} 



contains a language over {0,1}. 

In practice it is the simpler but only slightly less general Corol- 
lary 14 that we emphasize. (For nondecreasing time bounds the result is 
no weaker than Theorem 13.) 

Corollary 14 . NTIME(T 2 ) -U fNnMECTj)] T (n+1) € o(T 2 (n))} 
contains a language over {0,1}. 

Corollary 14 gives results that diagonalization does not give pre- 
cisely when log T„(n+1) € o(T 2 (n)). Corollary 15 is a refinement that 
gives new results even when log T_ (n+1) £ 0(T 2 (n)). 
Corollary 15 . 

NTIME(T 2 ) - U {NTIMECT,)! T^n+1) <E 0(T 2 (n)), T^n) € o(T 2 (n))} 
contains a language over {0,1}. 

For deterministic time complexity, we prove a version of Corollary 
14 that has an additional hypothesis. 

Theorem 16 . Suppose that there is some fixed k such that for each de- 
terministic TM acceptor M there is a deterministic k-tape TM acceptor M' 
and a constant c such that L(M') = L(M) and Time^^x) «s c»f (Time^(x)) . 
Then DTTME(T 2 ) - (J {DTTME^)] f(T L (n+l)) € o(T 2 (n))} ^ 0. 

When we restrict our attention to languages over a one- letter 
alphabet, we still get Theorem 17. 
Theorem 17 . If f is real-time countable, then 

NTIME(T 2 ) - U {NTTME(T 1 )| ^ (n+ f " X ' (n) ) £ o(T 2 (n))} 
contains a language over { 1} . 
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Chapter Three 
Containment: 

First we relate worktape alphabet size to storage space. 
Proposition 3 . NSPACE(S,m,j&) c NSPACE(S' ,m' ,£) 

if S(n)/S*(n) s 5 ^ log m' for some rational 6- Similarly for DSPACE. 

m 

The next two results relate the number of worktape heads to (the 
logarithm of) storage space. 

Proposition 4 . NSPACE(S, m, i-fk) C NSPACECS-Kk+l+eUog^ S, m, I) 
for every e > 0. Similarly for DSPACE. 

Proposition 5 . NSPACE(S + k.log m S, m, £) c NSPACE(S, m, Hk+3) . 
Similarly for DSPACE. 

Later on we relate multihead finite automata to logarithmic storage 

space . 

Lemma 21 . NHEADS(k) c NSPACE(log 2 n, 2 k , 1) c NHEADS(k-W) . 

Similarly for DHEADS, DSPACE. 

Separation: 

Theorems 18 and 25 are somewhat analogous to Corollary 14 and 
Theorem 17 of Chapter Two, especially in proof. 

Theorem 18 . NSPACE(S 2 ,m,M-3) - U [NSPACE(S 1 ,m,jt+2)| 1 € o(S 2 (n)-S 1 (n+l»} 
contains a language over {0,1} if S 2 is fully constructable by an (m,A)- 
machine. Similarly for DSPACE. 
Theorem 26 . 

NSPACE(S 2 ,m,je-f6) - U [NSPACE(S 1 ,m,A)| S^-S^n+f <n)) * 4-log m n} 
contains a language over just {1} 
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if S„ is fully cons true table by an (m,j&+2) -machine, 

log n £ o(S 2 (n)), 

f(n) 6 0(n) - 0(1) is nondecreasing and linear space honest. 
Similarly for DSPACE. 

Unlike Theorem 25, Theorem 27 applies even for logarithmic space 
bounds . 

Theorem 27 . NSPACE(S 2 ,2 ,1+1) - \J {NSPACE(S ,2 ,Z) | 1 f o(S 2 (n)-S (2n))] 
contains a language over just {1} 
if S„ is fully constructable by a (2, l) -machine, 

1 € o(S 2 (n) - log 2 n), 

l > 3. 



12 



CHAPTER TWO 



TIME SEPARATION THEOREMS FOR 
NONDETERMINISTIC MULTITAPE TURING MACHINES 

In this chapter we refer to what is usually called a nonde termini s- 
tic multitape Turing machine [HU69b] simply as a TM, and we refer to its 
deterministic version as a deterministic TM . If such an automaton has k 
tapes (each with a single read-write head) , then we call it a k-tape TM 
or a deterministic k-tape TM , respectively. We often let a TM receive 
an input , a finite string of symbols from some finite input alphabet £, 
initially written to the right of the head on tape 1, the worktape which 
we call the input tape. A TM can act as an acceptor by halting in some 
specified accepting state at the end of some computations. We assume 
the reader is familiar with how concepts such as these can be formalized. 
A good single reference for formal definitions relating to Turing machines 

is [HU69b]. 

* 
Definition . Let M be any TM acceptor. M accepts the string x € L » 

where E* is the set of all finite strings of symbols from £, if there 

is some accepting computation by M on input x. M accepts the language 

L(M) = [x| M accepts string x}. For x € L(M) , Time^x) is the number of 

steps in the shortest accepting computation by M on x; for x 4. L(M) , 

*We use the Kleene star more generally as well, along with other 

* 
regular expression notation for regular sets. For A, B c S » 
A+B=AUB=fx| x € A or x € B}, 
A.B = AB = {xy| x € A, y € B} , 

A * = [\] + A + A. A + A.A.A + • • • = f \) + A + A + A + • • • , 
where \ is the null or empty string. When it causes no ambiguity, we 
sometimes omit set brackets in regular expressions. 
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Time^(x) =00. 

Definition . A time bound Is a function T:N -♦ N with T(n) s n for every 
n. For T a time bound, the T-cutoff of the TM M is the language 
L T (M) = {x| Time^x) <; T(|x|)}, which is always a subset of L(M) . A 
language L is in NTIME(T) iff L = L(M) = L (M) for some TM acceptor M. 
Similarly, if M is deterministic and L = L(M) = L,_(M) , then L is in 
DTIME(T) . If L(M) = L T (M) , then we say that M accepts within time T . 

Other, slightly different, definitions of the NTTME and DTIME com- 
plexity classes have been proposed. Book, Greibach, and Wegbreit [BGW70], 
for example, say that M accepts within time T only if every accepting 
computation on input x € L(M) reaches the accepting state within T(| xj ) 
steps. Such differences do not affect the complexity classes determined 
by time bounds of the following type, however; and time bounds of prac- 
tical interest are of this type. 

Definition . If M is a deterministic TM acceptor with L(M) = 1 and 
Time^Cx) = T(| x| ) 2: | xj , then T is a running time , and M is a clock for 

T. 

Diagonallzation is the best known technique for obtaining separation 
or "hierarchy" results among the NTIME and DTIME complexity classes. A 
summary of the best separation results that have been proved by diago- 
nalization alone is given by the following pair of theorems. (See 
Appendix I, [HaS65] , [HeS66], (Con73].) 

Theorem 1 . If T_ is a running time, then each of the following set dif- 
ferences contains a language over {0,1} : 
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DTIME(T 2 ) - U {DTIMECT^I ^ <L Oi\ log \)} . 
NTIME(T 2 ) - U {DTIME(T X )| T 2 <L O^)}, 
DTIME(T 2 ) - U {NTIMEd^l log T 2 <2 0(1^}. 
Theorem 2 . If T 2 is a running time, then each of the following set dif- 
ferences contains a language over {1}: 

DTIME(T 2 ) - U.lMIMECyl \ 1°S T l € o(T 2 >}, 
NTIME(T 2 ) - U (DTIME^)! \ € o(T 2 >], 
DTIME(T 2 ) - U {NTIMECT^I \ € o(log T 2 )}. 
Remark . By restricting the unions of Theorem 2 to range only over run- 
ning times T^ we can use the diagonali Z ation technique of [MH71] to 
show that each of the following set differences contains a language over 
fl] if T 9 is a running time: 

DTIME(T 2 ) - U {DTIMECT^I ^ is a running time, T 2 * (X^ log T^}, 
NTIME(T ) - U {DTIMEd^)! ^ is a running time, T 2 tf 00^)}, 
DTIME(T 2 ) - U {NTIMECTpl ^ is a running time, log T 2 * 0(1^) }. 
Note the relatively poor results obtained in diagonalizing over 

NTIME. Not even the gross separation result NTIME(n 2 ) £ NTIME(2 n ) , for 

2 
example, follows directly from Theorem 1; yet, DTIME(n ) p 

DTIME(n 2 (log n) 2 ) does follow. Recently, however, Cook t Ck73] proved 

the following result by a new technique. 

Theorem 3 . NTIME(n r ) £ NTIME(n S ) whenever 1 £ r < s. 

in this chapter we pursue Cook's technical breakthrough, simplifying his 

Wn the precise specification of ■ ^^^ n ^£t£t. 
some context, we allow an imprecise specification ™^ n 1 ^ rlthil8 
of the »o" and "0" notations, the base and "™ d ^*°* ^towf 
in Theorems 1. 2 make no difference. (See also Lemma 7 below.) 
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proof and generalizing the result. The main generalization is Theorem 13 
below. We turn now to some lemmas that will be useful in the proof of 
that theorem and its corollaries. 

P. Fischer, Meyer, and Rosenberg [FMR72] have shown that every TM 
with many heads per tape can be simulated without time loss by a TM with 
only one head on each of some greater number of tapes. This allows a TM 
to carry out two computations at the same time, leading to proofs of the 
following lemmas. 

Lemma 4 . L(M) U L(M') can be accepted in time min{ Time^(x) , Time^ , (x) } . 

X*jnma_5. L(M) fl L(M') can be accepted in time max{ Time„(x) , Time^ , (x) } • 

Proof sketches . Combine M and M' by providing a second head on the 
first tape of each and a new input tape with a single head. Use the ex- 
tra heads to copy the input string at full speed from the new input tape 
onto the two old input tapes. Meanwhile the remaining heads can be used 
to carry out computations by M and M 1 on the respective transcribed cop- 
ies of the input string, even while they are still being transcribed 
from the real input tape. 
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new tape 



(read-only) 
head 



tape 1 of M tape 1 of M' 



ft- t t- 
new new 

(write-only) (write-only) 

head head 



tape 2 of M tape 2 of M' 



t t 



last tape of M last tape of M* 



t t 



. — v v — , 

tapes of M tapes of M' 

To accept L(M) U L(M'), the composite machine enters its accepting state 
when the computation by either M or M 1 does. To accept L(M) f] L(M'), 
the composite machine enters its accepting state when computations by 
both M and M' do. Thus we have described multihead multitape Turing 
machines that accept L(M) (J L(M') and L(M) D L(M') in the desired times. 
By the result of [FMR72], these can be simulated without time loss by 
multitape Turing machines with only one head per tape. O 
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The same technique leads to a proof of the "hex^ > lemmay j ift which a single 
TM carries out computations by M and a clock for^T simultaneously, 
accepting if M accepts before time T runs out. 

Lemma 6 . If M is a TM acceptor and T is a running time, then 
L T (M) € NTTME(T). 

The next lemma indicates that the NTTME complexity classes depend 
only on growth rates. It also shows that we need at least the condition 
T 2 & 0(1^) to be able to prove NT3ME(T 2 ) - NTTME(T,) f 0. It follows by 
Theorem 1 that, if (contrary to most people's intuition*) DTTME(T) = 
NTIME(T) for all T, then NTTME (T-) - NTIME(T^) * DTIME(T' ) - DTTMECT.) 
is nonempty precisely when the running time T^ 1st a member of the com- 
plement of O(T-). 

Lemma 7 . If ^ € 0(T.,), then NTIMECTj) cNTIME(T 2 ). 

Proof sketch . For T 2 (n) s (l+e)n for some e > 0, this is just the linear 
time speedup theorem of Hartmanis and Stearns [HaS65]. The idea is to 
increase the size of each TM's worktape alphabet so that several steps 
can be performed in one big step. 

That the lemma holds for arbitrary T 2 (n) 2 n has been observed by 
Book and Greibach [BG70], The key idea is to use nondeterminism to guess 
the entire input string before it is read. Q 

The following lemma, due to Book, Greibach, and Wegbreit [BGW70], 
indicates that for nondeterministic time complexity we can get by with 
TMs having a fixed number of tapes. No similar result is known for de- 
terministic TMs. 
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Lemma 8 . For each TM M there is a 2-tape TM M 1 and a constant c such 
that L(M') = L(M) and Tirne^ (x) £ cTime^x) for every x € L(M). 

Proof sketch . If M has k tapes, then the "display" of a configuration 
of M will be a (k+l)-tuple consisting of the control state and the k 
tape symbols scanned in that configuration. The display of a configura- 
tion determines which actions are legal as the next move and whether the 
configuration is an accepting one. The first task for M' is to nonde- 
terministically guess an alternating sequence of displays and legal ac- 
tions by M. The question of whether the sequence describes a legal com- 
putation by M on the supplied input is just the question of whether the 
symbols actually scanned on each tape when the actions are taken agree 
with the guessed displays. This can be checked independently for each 
tape in turn by letting the first tape of M 1 play the role of the tape 
while running through the guessed sequence of displays and actions. 
Clearly M' runs for time proportional to the length of the sequence it 
guesses. For further details, the reader is referred to [BGW701- O 

Lemma 9 . For no recursive time bound T does NTIME(T) contain all the 
recursive languages over {!}. 

Proof. Each recursive time bound lies below some running time T-, and 

T 

2 
Theorem 2 gives a recurs ive l anguage over {1} in DTIME(2 ) - 

NTIMECTj). D 



+ An idea of [BG70J allows us to take c = 1 if we settle for a 3- 
tape TM M 1 . (See Lemma 7.) Aanderaa [Aan74] has shown that we cannot 
get by with c«l in the deterministic case no mattes what fixed number of 
tapes we allow M' to have. (His counterexample is provided by determi- 
nistic TMs which accept in "real time" (Time^x) = |x|).) 
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Like Cook's proof of Theorem 3, our proof of Theorem 13 makes cru- 
cial use of a trick called "padding." Acceptance time is measured as a 
function of input length ; so if we can increase the lengths of the 
strings in a language L without significantly changing the time needed 
to accept the strings, then we get a padded language L' that is less 
complex than L as we measure complexity relative to input length. One 
way to pad the language L to L 1 is to take 

L' =£&! = {xlO k | x € L, |xlO k | = p(jxj)} 
for some p:N -» N with p(n) > n. 

Lemma 10 . If p(n) > n is a running time, then 

p(L) € NTIME(T) » L € NTIME(T op), 
where T op(n) = T(p(n)). 

Proof . (=>) Suppose M. accepts p(L) within time T. Design ML to pad its 

input string x (which is found at the read-write head on the first work- 

k k 

tape) out to xlO , where | xlO | * p(| x| ) , and then to compute on input 

xlO according to the transition rules of ML . Because p is a running 

time, the padding can be done in time p(|x|) by using an extra head on 

tape 1. A third head can be used for the computation by ML on input 

k 
xlO . Clearly, then, M 2 accepts L within time p(n) + T(p(n)) «£ 2-T(p(n)) 

But NTTME(2«T(p(n))) c NTIME(T(p(n))) , by Lemma 7. 

(<=) Suppose M_ accepts L within time T(p(n)). Design M. to check 

k ki 

that its input string is of the form xlO , where | xlO | = p(|x|), and 

then to behave like M„ on input x. Clearly ML accepts p(L) within time 

proportional to T(length of input to M. ), as required. O 

The following lemma shows how padding may be used to derive separa- 



20 

tion results. Ruby and P. Fischer [RF65] first used essentially this 
technique in connection with the deterministic time complexity of se- 
quence generation, and Ibarra [Ib72] used it more explicitly in connec- 
tion with the nondeterministic space complexity of language acceptance. 
(See Chapter Three of this thesis.) Ibarra has used similar techniques 
in other contexts as well ([Ib73a], [Ib73b], [IS73]). 

Lemma 11 . Let sets g , g„ of time bounds be given. Say p,(n) > n,..., 

p (n) > n are running times with Top. € 0(T 2 o p.) whenever 

1 £ i < i, T x € % v T 2 6 S 2 - 

If L € fl {NTIME(T 2 o p ) | T 2 6 g 2 } - U {NTIME^ o p^ | Tj_ € g^ , 

then p.(L) € {NTBffi(T 2 )| T 2 6 g 2 } - U {NTIMECT^I Tj € g^ for some i. 

Proof . For 1 £ i £ Z, let 

C(i,l) =U {NTIME(T lOPi )| Tj_ € g x }, 

C(i,2) =0 [NTIME(T 2 o Pi )| T 2 6 g 2 } . 
Suppose L € C(i,2) - C(l,l). By Lemma 7, NTTMEO^ o p i+1 > <= NTIME(T 2 o Pj ,) 
whenever 1 £ i < i, T € S, » T 2 € g 2 ; so, for lsi<l, 

L € C(i+l,l) =» L <= C(i,2). 
If we were to have also 

L € C(i,2) => L € C(i,l) 
for every i, then we would conclude from L € C(jfc,2) that L € C(l,l), a 
contradiction. For some i, therefore, we must have 

L € C(i,2) - C(i,l) 

= fl {NTIME(T 2 o Pi )| T 2 £S 2 ] - U {NTIMEC^ op ± )| ^ € 8^. 
By Lemma 10, 

Pi (L) 6 O {NTIME(T 2 )| T 2 € g 2 } - U {NTIMECT^I ^ € g^ 
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for that same i. C! 

Remarks . (i) We do not know how to exhibit the particular language that 
must be in Q {NTIME(T 2 )| T 2 € S 2 } - U {NTIME^j T ± € &J. 

(ii) The same technique can be applied to DTIME, and it allows us 

to strengthen the results of diagonalization a bit. For example we can 

2 2 1/200 

use it to show DTIME(n ) 5 DTIME(n (log n) ' ). (Take 

Pi (n) = n(log n) i/40 ° for <; i £ 399.) 

Another key idea in Cook's proof and our extensions of it involves 

a universal TM simulator. So that we may speak with precision about 

universal simulation, let us now choose an appropriate program coding 

for TMs. With each TM having at least two tapes and input alphabet 

[0,1], we associate a distinct program code from {0,1} ; and we do this 

in agreement with the easily- satisfied conditions listed below. We use 

the notation L for the set of program codes for k-tape TMs and L 

p.C. re r p#c# 

for the set of all program codes. We denote by M the TM with program 
code e. 

Con diti on 1 . No program code is a prefix of another, and L is in 

*— ^ ^ — p • c • 

DTIME (n) for each k. 

Condition 2 . For each fixed k, there is a TM acceptor U Q (a "universal 



simulator") with 

I e f L 
P 



L(U Q ) = {ex| e € Lp -C _» x € L(M e )}, 



Time TT (ex) £ c 'Time., (x) if e € L , 
U_ x/ e M ' p.c. 
e 

where c depends only on e. 

Condition 3. There is a recursive function f :L -♦ L such that 
p.c. p.c. 
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k k 11 

f:L -» L for each k and such that M r , N spends its first e steps 
p.c. p.c. f(e) r ' ' 

putting e at its head on tape 2 (by writing backwards) and thereafter 
acts according to the transition rules of M . (This condition is a 
variant of the s -theorem of recursive function theory [Rog 67].) 

Most common instruction-by- instruction or state-by-state codings of TM 
programs can be tailored to satisfy these conditions. An example of a 
satisfactory program coding is described in Appendix II. 

We shall want to pad strings and use the simulator that we design 
in a recursive control structure. To this end we use Condition 3 to 
prove one more lemma, a version of the fixed point theorem (recursion 
theorem) of recursive function theory. ■ 

* 

Lemma 12 . For each k-tape TM acceptor M with L(M) c {0,1} , there is a 
k-tape TM acceptor M with 

L(M e ) = {xj ex € L(M)}, 




2c(Time M (x) £ c + Time M (e () x)). 



e 

Proof. Let f be as in Condition 3. Take M to be a k-tape TM that 
e l 

operates as follows, given x at its head on tape 1 and e at its head on 
tape 2: 

1. Convert e to f(e). 

2. Convert x to f(e)x, and erase everything else. 

3. Operate according to the transition rules of M on input f(e)x. 
Let e_ = f(e_). Then by definition M operates as follows on input x: 

1. Spend e ' steps putting e. at the head on tape 2. 
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2. Convert e. to f(e.) = e... 

3. Convert x to e n x. 

4. Behave like M on e_x. 



Thus, 

x € L(M ) « e x € L(M), 
e U 

Time^ (x) <. c + Time^^x) , 

e o 

where c is the number of steps used in writing e. , converting e. to e Q , 
and writing e_ in front of x. O 

Theorem 13 . If T„ is a running time, then 

NTIME(T 2 ) - U {NTIMECT-)! there is some recursively bounded but strictly 

increasing function f :N -» N for which 

T^fCn+1)) € o(T 2 (f(n)))} 
contains a language over {0,1}. 

Proof . Let T_ be a running time, and let IL. be the universal simulator 
of Condition 2 for k = 2. By Lemma 6, L T (U Q ) € NTIME(T 2 ). Let f:N -♦ N 
be any recursively bounded but strictly increasing function. We prove 
that L T (U Q ) £ NTIME(T ) for any time bound T with T^fCn+1)) € 

o(T 2 (f(n))). 

Suppose that U. accepts L (U_) within time T_, where T-(f(n+l)) e 

o(T 2 (f(n))). By Lemma 4, there is an acceptor U for 



'The operator gap theorem ([Con72], [Yng71]) shows that such re- 
sults are impossible without some "honesty" condition on T„ such as T„ 

a running time. For example the operator gap theorem can be used to 
show that there are arbitrarily large, arbitrarily complex time bounds T 
for which NTIME(T(n)) equals NTIME(n.T(n+l)) , even though T(n+1) is 
certainly a member of o(n»T(n+l)). 
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L(U X ) U L(U Q ) = L T (U Q ) U L(U Q ) = L(U Q ) 

2 
such that for every e € L , 

p.c. 

{1^(1 ex|), if c e .Tlme M (x) < T 2 (|ex|); 
c •Time^ (x) , in any event, 
e 

Note that when T (|ex|) < Time^ (x) £ T 2 (|ex|)/c e> the universal simula- 

e 

tor U will simulate the computation of M on x faster than the computa- 
tion runs directly; i. e. , there will be simulation time gain . This ex- 
treme efficiency will lead below to a contradiction of Lemma 9. 

Let L <r {1} be any recursive language over {1}. Because L is re- 
cursive, we can take a running time T so large that L € NTIME(T). Let M 
accept L within time T. Design a TM acceptor M' that operates as 

follows: 

2 * * 

1. Check that the input string is a member of L »1 »0 , and 

P • c • 

parse it into e 6 L 2 , x € {1} , and . Condition 1 guaran- 

p • c • 

tees that this can be done in time that is linear in the length 
of the input string. 

2. Use a clock for the running time T to determine whether 

k 2: T(|x|). This requires at most k steps, so it can be done 
in linear time, too. 

3. If k2 T(|x|), then erase everything but x and compute on input 
x according to the transition rules of M. For x € L(M) , since 
Time M (x) £ T(jxj) s; k, this step can be performed in linear 

time, too. 

k' 

4. If k < T(|x|), then pad the input string to exO for some non- 
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deterministically chosen k' > k, erase everything else, and 

k' 
compute on input exO according to the transition rules of the 

universal simulator U. This step can be performed in linear 

k 1 
time plus Time (exO ) . 

To summarize the behavior of M 1 on exO , 

k £ T(jx|) => behave like M on x; 

k < T(|x|) =» behave like U on exO for some k 1 > k (thus simulating 

k' 
M on xO ). 
e 

To summarize the timing for exO € L(M'), 



Time^ , (exO ) s; 



fd^lexO 1 "! . if k a T(|x|); 
d 1 .|exO k '| + Time u (exO k '), if k < T(| xj ) 



for some constant d and every k' > k. 

Applying Lemma 8 to obtain a 2- tape TM that accepts L(M') with only 

linear time loss, and then applying the recursion theorem (Lemma 12) to 

this machine, we get a program code e_ for a 2- tape TM that accepts 

L(M ) = {xO k | e xO k € L(M')} c 1*0* 
e U 

within time 

Time^ (x0 k ) s d 2 .Time M , (e Q xO k ) 

e o 

for some constant d„. 

* 
Claim 1 . For each string x £ {1} , the following holds for every k: 

xO e L(M ) « x € L. 

e o 

Proof . For each x we establish the claim by induction on k running down 
from k a T(|x|) to k = 0. 
k S T(|x|): 
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xO k 6 L(M ) » e.xO k € L(M') 
e ° 

(by choice of e R ) 
ox€ L(M) = L 

(because by definition M' behaves like M in this 

case). 

k < T(lxl): Assume xO k ' € L(M ) o x € L holds for every k' > k. Then 

e 

xO k € L(M e ) « e Q xO k € L(M') 

(by choice of e Q ) 
« e xO k € L(U) for some k* > k 

(because by definition M' behaves like U in this 

case) 

It' 
o xO € L(M ) for some k' > k 

e o 

(because e Q € L p c ) 

« x € L 

(by induction hypothesis). O 

Claim 2 . For each sufficiently long string x € L, the following holds 

for every n 2: | e_x| : 

f(n)-|e n x l 
Tlmc^ (xO U ) s: d 3 .T 1 (f(n+l)), 

e o 

where d = d„d + d_. 

Proof . Let x € L be so long that 

c .d..T.(f(n+l)) i T_(f(n)) 
e Q 3 1 2 

for every n s ( e xj . (This uses the "translational" hypothesis 

T (f(n+l)) € o(T-(f(n))).) We establish the claim for x by induction on 
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n running down from n so large that f(n) 2 | e Q xJ + T(|x|) to n = | e Q x| 
f(n) * |e x| +T(|x|): 

f(n)-|ex| f(n)-| e x l 

Time^ (xO ) £ d^Tirnc^, (e Q xO ) 



e o 



* d 2 -d 1 .f(n) 



(because f(n)-|e x| i T(jx|)) 



s: d 3 .T 1 (f(n+l)) 



e x| s n s: f (n) < | e Q x} + T(| x| ) : 



f(n+l)-le x| 



Assume Timt^ (xO ) s: d 3 »T 1 (f(n+2)). Then 



e o 



f(n+l)-|e x| 
c .Timei, (xO u ) £ c -d,.T, (£(n+2» 
e \ e 3 * 

£ T 2 (f<n+1)) 

(because n is so large) . 

Therefore , 



Time^eQxO u ) * T^ffr+l)). 



f(n+l)-|e x| 
) u 

Therefore , 

f(n)-jex} f(n)-ie Q x| ' 

Time M (xO u ) S d 2 .Tlme M ,(e xO u ) 

6 ° f(n+l)-|ex| 

i d^dj.f^+l) + d^TlnejjtejjXO ) 

(by padding out to length f(n+l) > f(n)) 

s; d 2 .d 1 .f(n+l) + d 2 .T 1 (f(n+l)) 

£ d 3 .T 1 (f(n+l)). D 

Claim 3 . For each sufficiently long string x £ L, 

Timejj (x) s d 3 .T 1 (f(|e () x|+l)). 
e 



mmmmmmmmmmmmm. 



W"™ 



28 



Proof. Let x 6 L b^ ft long a* in tha proof of CUi* 2. ttan 
rswx. wi- * ^ « *"\«?T- f - : * i. <*s> i -»"^ s»3P*l o« ft am- 7 *•<-.- 



"S 



.3), 



"fi"* !■" ^ f? - s + 



_- r i 



llnrcfore, 









Tberaiora, 



(f!+nn)-»f* 



V 



fhv Mttlitm^ fa^ 

Finally, l»y 1 iw a jif #£«# ^Jfeiffp** 

to r*$oet 

with M on abort 

fltis gives ■ Bt that aceaa#a L • 

If gUi 






:Cjr-;T -»■ iaCgO-' > (a)". .. r: > Lk^s I 




*'nM»(|I^P'- '«pWWWP^- 







;;• ,1'jkj' cS 5«o gsl.M»fe«f f*0 



7 give. $_€ ™__ 



arbitrarily, and by Liwn t ait 
th« particular claaa W9M|£ .-» £ 




Bacaaola . - 'For. an arbitrary uti of 



MM&flF- *a* *e in 




29 



(i, if n € A; 
n, if n i A; 
In, if n € A; 
1, if n i A. 



2 3 

To see that NTIME(n ^(n)) g NTIME(n ), just apply Theorem 13 vith 



!2n, if n € A; 
2n+lj if n I 1 



f(n+l) = 



In many applications it suffices to have Theorem 13 for the single 
function f(n) = n, especially if we are concerned only with nondecreas- 
ing time bounds. 

Corollary 14 . If T„ is a running time, then 

NTIME<T 2 ) - U {NTIMECT^I T^n+1) € o(T 2 (n))} 
contains a language over {0,1}. 

The informal diagram in Figure 1 illustrates how the proof of Theo- 
rem 13 uses padding to take advantage of deeply nested simulations by U 
to bring the time for an arbitrary computation down to the vicinity of 
T- and T- in the case f(n) = n. The direct computation on x, up around 
the level of T(| x| ) , is brought down to below T 2 in terms of the input 
length by padding x out to xO '' x l'. By the hypothesised nature of U, 
simulating that computation brings its time down to below T. . If we un- 
pad by a single 0, then the hypothesis that T.(n+1) is small compared to 

T 2 (n) keeps the computation still below T- in terms of the input length. 

Tdxl)-1 
A simulation by U of this computation on xO M '' brings its time down 

to below T. . Continuing to nest alternating unpaddings and simulations 

finally yields a computation on the original input string x down at the 
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level of T- and T~. 

The "translational" condition T,(n+1) € o(T ? (n)) is a severe one 
for a rapidly growing running time T„. When T 2 (n+1) is worse than expo- 
nential in T 2 (n), in fact, deterministic diagonalization within time 
bound T„ (theorem 1) yields stronger results than does Corollary 14. 
Because Corollary 14 applies for T, (n-H.) € o(T„(n)) and Theorem 1 applies 
for log T 2 (n) 4. 0(T-(n)), it is easy to see that Corollary 14 contributes 
new results precisely when log T 2 (n4i) € o(T 2 («)). 

2 

* 2* 

To see the strength of Corollary 14, let log n = min(kj n £ 2 _ ^ ) . 

k 

For constants c > 1, r al whose digits in radix notation can be generated 

r r * 
rapidly, and in particular for rational c, r, note that n , n >log n, 

n • (log n) , c , c «log n, etc. are running times. Thus we conclude 

that 

2. 



NTIME(n r ) C NTlME(n r «log n) c NTDCE<n r . (log n))g.»., 
NTIME(c n ) g NTIME(c n .log* n) g NTIME(c n . (log^ n) 2 ) C •••. 

These results do not follow immediately from Cook's result (Theorem 3) 

or by diagonalization (Theorem 1) . 

Corollary 14 obviously implies that 

2 2 

NTIME(2 n ) 5 NTIME(2 (n4 ' 1) -log* n), 

2 n 2 n+1 * 

NTIME(2 ) 5 NTIME(2 -log n) . 

In fact we can strengthen these results to x 

2 2 

NTIME(2 n ) c NTTME(2 (n+1) ), 
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2*1 2 n+ l 

NTIME(2 ) 5 NTIME(2 ) 

by appeal to the following corollary. 

Corollary 15 . If T„ is a running time, then 

U {NTIMEOrpJ T^n+1) € 0(T 2 (n)), T^n) 6 o(T 2 (n))} £NTIME(T 2 ); 
and there is a language over {0,1} that bears witness to this fact. 

Proof . Because T (n) € o(T 2 (n)) implies ^((n+D+l) € o<T 2 (n+2)), 

* 
Corollary 14 gives a language L c {0*1} in 

NTIME(T 2 (n+2)) - \J (NTIMECT^n+l))! T^n+1) € 0<T 2 <n)), T^n) 6 o(T 2 (n))}. 

Applying Lemma 11 with 

S l = * T ll T l (n+1 > € 0(T 2 (n)), T x (n) € o(T 2 (n»}, 

* 2 = C^ 2 }, 

P x (n) - n + 1, 

p 2 (n) = n + 2, 
we conclude that either p. (L) or p 2 (L) is a member of 

NTIME(T 2 ) -(J {NTIMECT^I ^(n+l) € 0(T 2 (n)) , T^n) € o(T 2 (n))}. 
Containment holds by Lemma 7. r~l 

Remarks , (i) Lemma 11 goes through equally well if we pad to the left 
rather than to the right. For this remark, then, we may assume that 
p ± a) - {0 k lx| x € L, |0 k lx| = p (|x|)} for i - 1, 2 above. 

For U_ the universal simulator of Theorem 13, L = L ( +2 \( u o) sat " 
isfies the condition for choosing L in the proof of Corollary 15. One 
might suppose therefore that L , > (U_) would be a witness language for 

Corollary 15. If we slightly modify our program coding by concatenating 
a single 1 in front of each old program code and if we let U ' be the 
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naturally derived new universal simulator, then we do indeed get 

^(nVV) = ^(nVV = P 1 (L) - Similar1 ^ if We further COn " 
catenate a in front of each program code and let U " be derived from 
U_* by taking this into account, then we get L T / n \( u ") = 

01. L T / n+2 ^( u o^ = P2^" Yet we can show only that elther L T (n)^ U o' '^ 

or L , ,v(U ') is a witness to Corollary 15. We leave it open whether 
T 2 (n+1) 

there is necessarily a witness language of the form L e n }^(P ^^ 
whether the particular choice of U affects whether L T , » (U Q ) is such a 

language. 

(ii) Corollary 15 contributes new results (over Theorem 1) precisely 
when log T 2 (n+1) € 0(T 2 (n)). 

It is interesting to note that the containments corresponding to 
the examples following Corollary 14 are not known to be proper for de- 
terministic time (DTIME) . The fundamental reason is that Lemma 8 is not 
known for DTIME. The proof of Theorem 13 in the case of such an easy 
function f as f(n) = n does carry over in every other detail, however, 
to give Theorem 16. 

Theorem 16 . Suppose that there is some fixed k such that for each de- 
terministic TM acceptor M there is a deterministic k-tape TM acceptor M' 
and a constant c such that L(M') = L(M) and Time^.Cx) <. cf (Time^x)) . 
Then 

DTIME(T 2 ) - U [DTIMECT^I fCT^n+l)) € o(T 2 (n))} 4 
for every running time T„. 
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Remark . We do not require that M' be effectively constructable from M; 
if it were, then we could actually diagonalize to get 

DTIME(T 2 ) - LJ {DTIMEd^l T 2 (n) 4 0<f(T x <n)))} 4 0, 
a somewhat stronger result. 

Example . If we should discover even a nonconstructive proof that for 
each deterministic TM acceptor M there is a deterministic 5- tape TM ac- 
ceptor M* and a constant c such that L(M') = L(M) and 
Tirae^Cx) «s c»Tim«" (x), then we could conclude that 

DTIME(T 2 ) - U [DTIMECT^j TjCn+l) € o(T 2 (n))} 4 
for every running time T«. 

Padding strings over a one- letter alphabet by one character at a 
time does not leave them decodable, so we cannot hope to use our method 
to get a result as strong as Corollary 14 for languages over a one-letter 
alphabet. The final result of this chapter demonstrates that we can 
come very close, however. 

Definition . The rounded, inverse of a strictly increasing function 
f:N -» N is the function f" 1 :N -» N defined by 
r f" n (n) = min{k| f(k) 2 n}. 

Examples . function rounded inverse 

n 2 r B iyn 

2 n riog 2 nl 



* 
log n. 
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Theorem 17 . If T 2 is a running time and f is real-time countable, then 
there is a language over {1} in 

NTIME(T 2 ) -(J {NTIMECr^j T^n + 'f" 1 " 1 ^)) € o(T 2 (n))}. 

Proof . Let T_ be a running time, and let f be real-time countable. To 
adapt the proof of Theorem 13, we must construct a witness language as 
the T--cutoff of some "universal simulator" having input alphabet {1}. 
We start with U Q as in the earlier proof; i. e., U_ is the universal 

simulator of Condition 2 for k = 2. 

* 
Define an injection g:{0,l} -♦ N so that the binary representation 

of the integer g(x) is lx; i. e. , we concatenate a high-order digit 1 to 

x to get the binary representation of g(x) . Define another function 

h:{0,l} -> N by the conditions 

h(xO) - h(x) + r f _1 ^(h(x)), 

h(xl) = f(g(xl)) + g(xl) - 1, 

h(\) = f(l). 
Because g is an injection and f(n)+n-l is strictly increasing, h(xl) = 
h(yl) only if x - y. Because n+ f" (n) is strictly increasing, h(xO) = 
h(yO) only if h(x) = h(y). Unless there are strings x, y with h(xO) = 
h(yl), therefore, h must be an injection. For such strings to exist, 

r -ii 

the ranges of the strictly increasing functions n+ f (n) and f(p)-Ki-l 
must intersect; but 

(f(n)-l) + r f _11 (f(n)-l) = (f(n)-l) + (n-1) 



+ 
A strictly increasing function f :N -» N is real-time countable 

[Yam62] if some deterministic Turing machine generates the characteristic 

sequence of the range of f in real time (i. e. , one character per step). 

(The characteristic sequence has a 1 in position n if n is in the range 

of f and a otherwise.) 
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< f (n) + n - 1 

< f (n) + n 

= f(n) + l "f" 11 (f(n)), 
so the ranges do not intersect and h is an injection. 

Because f is real-time countable, we can compute 1 ' from x or 
x from 1 w within time proportional to h(x), within time 2.h(x) if we 
wish. From U_ we construct U ' to operate as follows on input y € {1} : 

1. Find x with l h * x) = y if it exists. 

2. Compute on x according to the transition rules of U n - 

By Lemma 6, L^ (U Q ') € NTIME(T 2 ). We prove that L T (U ') i NTIMECr.) 

r -n 

for any time bound Tj with T^n + 'f '(n)) € o(T 2 (n)). 

Suppose that U * accepts L (U ') within time T., where 

T x (n + f" (n)) € o(T 2 (n)). By Lemma 4, there is an acceptor U' for 
L(Y> U L(U Q ') = Lj. (U «) U L(U Q ') = L(U «) 

2 
such that for every e € L , 

p. c. 



f^ChCex)), if 2.h(ex) + c^ 
2.h(ex) + c e .Time M (x) , in j 



■Time^ (x) <: T ? (h(ex)); 
Time^l^),]/ v 

any event. 



e 
Finally, construct U to operate as follows on input x € {0,1} : 

1. Compute l h * x *. 

2. Compute on 1 W according to the transition rules of U' 



Then 



L(U) = {x| l h(x) e L(U')} 
= {x[ I h(x > € L(U ')} 
=L(U ); 
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2 
and, for every e € L , 

p • c • 

Time^ex) £ 2.h(ex) + Time^ (i h(ex >) 

12.h(ex) + T^Mex)), if 2.h(ex) + c e .Time M (x) 
<; T 2 (h(ex)); 
4«h(ex) + c »T (x), in any event. 
► e 

For any recursive L c= {1} , we can use U just as in the proof of 

■if 
Theorem 13 to get a 2- tape TM acceptor M for L«0 , with 

e o 

. fd .je xO k |, if k* T(lx|); 
Tinu» (xO*) s I ,' 

e iV e X ° 1 + d 1 *Time u (e xO k+1 ) , If ■ k < T(| xj ) 
for some sufficiently large constant d. and some appropriate time bound 
T. 

Claim . For each sufficiently long string x € L, the following holds for 
every k: 

Time^j <xO k ) £ d^T (h(e xO k+1 )) , 

e o 

where d_ = 4d. . 

Proof . Let x £ L be so long that 

(2 + c e .d 2 ). Tl (n + r f" 11 (n» * T 2 (n) 

for every n ;> h(e x). We establish the claim for x by induction on k 
running down from k 2> T(| x| ) to k = 0. 

k*T(|x|): 

Time M (xO 1 *) * d^e^O^ 



e 



£ d 2 . Tl (h(e xO K+i )). 



k<T(|x|): 
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k+1 k+2 

Assume Time^ (xO ) £ d-'T-ChCe.xO )). Then 

e o 

2.h(e Q xO k+1 ) + c -Time (xO k+1 ) 

e ° e O 
£ 2.h(e xO k+1 ) + c e .d 2 .T 1 (h(e () xO k+2 )) 

= 2.h(e xO k+1 ) +c e .dj.Tj.ChCe^"*" 1 ) + V^OiCe^ 1 ^ 1 ))) 

* (2 + c e .dp.TjChCeQxO^ 1 ) + r f- ll (h<e xO k+1 ))) 

<: T 2 (h(e xO k+1 )) 

(because x is so long). 
Therefore, 
Time u (e xO k+1 ) * 2.h(e Q xO k+1 ) + TjCh^xO** 1 )) 

* 3.T 1 (h(e xO k+1 )). 
Therefore, 
Timej^ (xO k ) s d 1 .|e () xO k+1 | + d 1 .Tlme u (e () xO k+1 ) 

e o 

«; d^le^O* 41 ! + 3d 1 .T 1 -(h(e xO k+1 )) 
<: d 2 .T 1 (h(e () xO k+1 )). D 

If H is a nondecreasing recursive function so large that 
h(y) £ H(|y|) for all y € {0,1} , then the claim gives the following for 
every sufficiently long x € L: 

Time M (x) <; d^T^e^O)) 



e o 



= d 2 .T 1 (h(e Q x) + r f- n (h(e x))) 

£ T 2 (h(e x)) 

* £ T 2 (n«) 
n'^H(|e |+{x|) Z 



39 



£ £ T (n 1 ). 
n'<;H(2.|x|) 

It follows by Lemmas 4, 5 that L € NTIME( S T„(n')). Since L is an 

n'<ffl(2n) 

arbitrary recursive language over {1}, this contradicts Lemma 9. G 
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Example . Taking f(n) =2 , we get a language over {1} in 

2 n 
2 

NTIME(2 n .log* n) - NTIME(2 n ). 

We close with a list of open questions. 

1. For T„ a running time, is the condition T„ £ 0(T. ) enough in general 
for separation between NTIME (T.) , NTIME(T 2 ) or between DTIMECT-), 
DTIME(T 2 )? 

2. Is there an actual difference between the separation results that 
hold for NTIME and those that hold for DTIME? 

DTIME(n ) 5 DTIME (n 2 ^ log log n)? 

2 n 2 n+1 * 

NTIME(2 ) c NTIME (2 /log n)? 

Is there a language over a one-letter alphabet in 

2 n+l 2 n 

NTIME(2 ) - NTIME(2 )? 

3. What is the relationship between NTIME and DTIME? 
NTIME (T) = DTIME (T)? 

4. That a language L is not a member of NTIME(T.) means only that every 
acceptor M for L has Time^(x) > T..(|x| ) for strings x € L of infi - 
nitely many lengths . Stronger senses of lower bounds, requiring 
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that Time^(x) > T.(|x|) for strings x € L of all but finitely many 
lengths or for all but finitely many strings x € L have been studied 
extensively. (See [Blm67], [Lyn72], [GB74], for example.) It is 
known, for example, that there is a language L that requires 2' x > 
many steps deterministically on almost every string x 6 L but that 
can be accepted deterministically within time (2+s) n for any e > .0. 
Our methods do not give such results for nondeterministic acceptance 
time complexity, so we leave it open whether there is a language L 6 
NTIME((2+e) ) that requires, even on nondeterministic machines, 2' x ' 
steps on inputs x € L of all but finitely many lengths or on all but 
finitely many x € L. 

5. A purely technical question arising from Theorem 13 is whether we 
can allow f to range over all one-one functions rather than just 
strictly increasing, recursively bounded ones. A plausible proof 

strategy is to design M' in the proof of Theorem 13 so that, in the 

ii k k' 

case k < T(|x|), it pads or unpads exO to exO for some nondeter- 

ministically chosen k* ^ k. Under this strategy, however, Claim 1 

seems to elude proof. 

6. What is the relationship between deterministic time complexity and 
number of worktapes? 

7. What is the relationship between time complexity and worktape alpha- 
bet size? (Cf . , Chapter Three.) 

8. Is there any language in NTIME(T 2 ) that requires more time than the 
language L ? (U Q ) in the proof of Theorem 13? 
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9. In the conclusion of Lemma 11, can we exhibit a single language that 
must definitely belong to {NTIME(T 2 )| T 2 € § 2 } - U [NTIMECr^l 
T 1 € S,}? (Cf • , Remark (i) following Corollary 15.) 
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CHAPTER THREE 



SPACE SEPARATION THEOREMS FOR 
OFF-LINE TURING MACHINES 

1. Basic definitions 

To study Turing machine storage space complexity, we adopt a Turing 
machine model that has a read-only input tape and a single read-write 
worktape. The input string is received between the special endmarkers 
4 y $ on the input tape and is read by a single read-only input head 
which is allowed to move freely between the endmarkers. The worktape is 
infinite to the right only. For technical reasons, we allow any fixed 
finite number of freely moving, but initially left-adjusted, read-write 
heads on the worktape. The worktape heads can detect both each other and 
the left end of the worktape, and they are never required to write con- 
flicting symbols on a single tape square in the same step or to shift 
left past the left end of the worktape. We refer to such an automaton 
as an off-line TM . An off-line TM with m ;> 2 symbols in its worktape 
alphabet (counting the blank symbol, which may be used without restric- 
tion even in overwrite instructions) and I ;> 1 worktape heads is called 
an (m,!,) -machine or just an m-machine . The deterministic restrictions 
of these automata are called deterministic off-line TMs and deterministic 
(m,jt) -machines , respectively. 

An off-line TM can act as an acceptor by halting in some specified 
accepting state and with a blank worktape at the end of some computations. 

Definition . Let M be any off-line TM acceptor. M accepts the string x 
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if there is some accepting computation by M on input x. M accepts the 
language L(M) = fx| M accepts string x}. For x € L(M) , Space^x) is 
the minimum number of distinct worktape squares visited by the worktape 
heads of M in an accepting computation by M on x; for x £ L(M) , 
SpaceL^x) = oo. For S:N -♦ N, define 

L g (M) = {x| Space^x) £ S(|x|)}, 

NSPACE(S,m,j0 ■ {LJ L = L(M) = L g (M) for some (m,l)-machine M}, 

NSPACE(S.m) = \J [NSPACE(S,m,i)j I > 1} , 

NSPACE(S) -U {NSPACE<5,m,l)| m % 2, 1 2 l} t 

DSPACE(S,m,i) - [LJ L = L(M) - LgCM) for some deterministic (m,A)- 

machine M% 

DSPACE(S,m) - (J {DSPACE(S,m,i)| Ail}, 

DSPACE(S) =U {DSPACE(S,m,l)j ai2, Ul}. 
We call L C <M) the S-cutoff of M, and we say M accepts within space S if 
L(M) = L_(M). If NSPACE(S) contains languages which are not regular, 
then S is a space bound . Every subscripted or primed S mentioned below 
is assumed to be a space bound. 

Proposition 1 . No space bound S satisfies S(n) € o(log log n). 
Proof . See [HU69a]. O 

It is well known that the NSPACE(S) and DSPACE(S) complexity classes 
are generally insensitive to machine model design variations. The 
NSPACE(S,m,jD and DSPACE(S,m,j&) complexity classes, on the other hand, 
are sensitive to machine model design; but the differences are usually 



^Acceptance is to be distinguished from "recognition." If the off- 
line TM M can accept either L <= £* or £ - L (within space S) , depending 
on accepting state designation, then M recognizes L ( within space S ) . 
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minor. Following are comments on the effects of some common design 
variations. 

1. Suppose that we redefine our (m,i) -machine model so that its 
worktape heads cannot detect each other. If the resulting complexity 
classes are NSPACE' (S,m,A) , DSPACE' (S.m.jQ , then we have 

NSPACE'(S,m,jt) = NSPACE(S,m,jt) , 

DSPACE 1 (S.m.jfc) = DSPACE(S,m,A) . 
To see that detectability is no real advantage, it suffices to observe 
that detection can be simulated by the redesigned model. The trick is 
to make a temporary change under each worktape head in -turn, letting 
each head discover which other heads' temporary changes take place on 
the square it scans. 

2. Suppose we redesign our (m, A) -machine model so that it cannot 
detect the left end of its worktape but instead halts without accepting 
if it shifts past that end. If the resulting complexity classes are 
NSPACE ' (S , m, A), DSPACE '(S,m,i) , then we have 

NSPACE' (S,m,£) c NSPACE(S,m,i) c NSPACE* (S,m,jt+1) , 

DSPACE' (S,m, J) c DSPACE(S,m,£) c DSPACE 1 (S,m,je+1) . 
Our model simulates the redesigned one simply by halting when it detects 
that the transition rules would lead to a shift off the end of the work- 
tape. The redesigned model simulates ours by permanently stationing an 
extra worktape head at the leftmost worktape square. Detection of that 
square can then be effected by the trick of comment 1 above. 

3. Suppose we redesign our (m,i)-machine model so that its work- 
tape is infinite in both directions. If the resulting complexity classes 
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are NSPAGE' (S,m,A) , DSPACE * (S ,m , I) , then we have 

NSPACE '(S,m, A) c NSPACE(S,m,Jt+l) c NSPAGE* (S,m,jfc+2) , 
DSPACE' (S,m, 4) c DSPACE (S,m, 4+1) c DSPACE' (S,m,je+2) . 
To simulate the redesigned model, our model must be able to provide new 
worktape squares for shifts past the left end of the worktape. It suf- 
fices to shift all the work to the right (making temporary use of the 
worktape head that needs the new tape square), and this is made possible 
by using an extra worktape head to mark the rightmost worktape square 
that has been visited. (Nothing to the right of this head need be 
shifted because it is all blank anyway.) The redesigned model simulates 
ours by permanently stationing an extra worktape head at the initial 
worktape square and treating that square as the left end of the worktape. 
In the nondeterministic case we actually have 
NSPACE ' (S ,m , jt) c NSPACE (S ,m , X) 
because our model can nondeterministically guess where to start its 
simulation so that no shift past the left end of its own worktape is 
called for. 

4. Suppose that we redefine acceptance by our (m,j&) -machine model 
so that a blank tape is not necessary. If the resulting complexity 
classes are NSPACE' (S,m,|) , DSPACE 1 (S,m,J) , then we have 
NSPACE '(S,m,j&) c NSPACE(S,m,|+l) c NSPACE' (S,m,je+2) , 
DSPACE 1 (S,m, 4) c DSPACE(S,m,jfc+l) c DSPACE 1 (S,m,|+2) . 
Our model simulates the redesigned one simply by erasing its worktape 
when the transition rules call for acceptance. This is made possible by 
using an extra worktape head to mark the rightmost worktape square that 
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has been visited. (Nothing to the right of this head need be erased be- 
cause it is all. blank anyway.) The redesigned model simulates ours by 
cheeking whether its worktape is blank begone entering the accepting 
state. This is made possible hy again using an extra worktape head to 
mark the rightmost worktape square that has been visited. 

in the nondsterministic ease: we actually have 

NSEftOR* (S,m,*) c NaPAGE(S^a f l) 
because our model can nundebexsihisticaily guess where to start erasing 
in preparation fox- acceptance. 

5s Suppose we? re d e sig n oar (m*.& m a chine model so that it has k 
work tapes. M the resulting cnm pl i mr f t y classes (idttained by counting 
the total number of visited worktape souares, ther total alphabet size, 
and the total number of worktape heads) ace > VBBMBf HftatJ^r BBBMEB* {8 ,*,£) , 
then we have 

NSPACE* (S,my0 c HSPACE(S ,m»JJ»&J <r l^HICB?^^*,^!*) , 

DSPAeE'<&,m»j© cr BSPMEC^,mi#liO< <r D8ii»WX&i»,J l «e> • 
Our model simulates the redesigned, one by storing the concatenation of; 
the visited portions of the k tapes on tim, one taps. The k extra heads 
**1 ' * " *^k tam:USe ^ to delimit these k: segments. New worktape squares 
are provided where: needed: by shifting work rd^ghte,, much as in comment 3 
above. 



tape 1 work 



tape 2 work 



A 



tape k work 



blanks* •• 



1 ►. * •, 

h l h 2 \~1 \ 

The simulation of our model hy the redesigned one is trivial. 
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6. Suppose that we redefine our (m,jfc) -machine model so that the 
blank symbol is reserved for worktape squares that have not yet been 
visited. If the resulting complexity classes (obtained by counting only 
nonblank worktape symbols now) are NSPACE' (S,m,£) , DSPACE 1 (S,m,jJ) > then 
we have 

NSPACE ' (S ,m , j&) c NSPACE (S ,m , t+l) c NSPACE • (S ,m+l , jj+l) , 

DSPACE * (S ,m , I) c DSPACE (S ,m, jt+1) c DSPACE * (S ,m+l ,l+\). 
Our model simulates the redesigned one by using its blank symbol for one 
of the ordinary symbols of the new model. An extra worktape head is 
used to mark the rightmost worktape square that has been visited, beyond 
which the blank represents the true blank symbol of the simulated machine. 
The redesigned model simulates ours by using an extra unrestricted sym- 
bol along with its restricted blank symbol to represent the unrestricted 
blank of our model. 

The relations among design decisions revealed by considerations 
such as those above provide a convenient way of converting the results 
of this chapter to good results for any of the redesigned machine models. 
Slightly better results often are obtained by converting the original 
proofs, however, making better use of nondeterminism (cf . , comments 3, 4 
above) or of worktape heads not yet fully utilized, for example. 
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2 . Basic containment relations 

In this section we present all the known containment relations 
among the complexity classes defined in Section 1. The trivial relations 
are that no language is lost from a complexity class by allowing nonde- 
terrainism, additional space, additional worktape symbols, or additional 
worktape heads. 

Only slightly less trivial is the use of the finite state control 
to save space. 

Proposition 2 . If S 2 (n)-S ]L (n) £ 0(1), then 
KSFA£E(S 2 ,m,£) c NSPACE(S ,m,J) , 
DSPACE(S 2 ,m,jt) c DSPACE(S ,m, jfc) . 

It follows, for example, that the complexity class DSPACE(n ,2,1) is 
not affected by how we round the square root. For convenience, therefore, 
we allow such an imprecise specification of a space bound when the pre- 
cise specification is not relevant. 

The basic relationship that DSPACE(S 2 ) c DSPAGE(S ) whenever 
S 2 £ OCS^ appears in [SHL65]. It allows us to speak of DSPACE(log n) 
without specifying the base of the logarithm, for example. Our next 
proposition generalizes the relationship. 

Proposition 3 . If S(n) ^ 6-S*(n) for some fixed rational number 
S :£ *°8_ m ' > then 

NSPACE(S,m,i) <= NSPACE(S' ,»• ,1) , 

DSPACE(S ,m,|) e DSPACE(S * ,m» ,i) . 

Proof sketch . Say 6 = i/j for positive integers i, j. As m £ m'^, we 
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can encode the contents of i m-symbol-resolution worktape squares in j 
m' -symbol-resolution worktape squares. Q 

Example . For k a positive integer, 
NSPACE(k.S,m) = NSPACE (S ,m k ) . 

Additional worktape heads often can satisfy an apparent need for 
additional worktape symbols. Our technical reason for allowing several 
worktape heads is that additional worktape heads amount to much less 
additional space than additional symbols do. Proposition 3 establishes 
the close relationship between worktape symbols and a linear multiple of 
worktape space, and our next two propositions establish the close rela- 
tionship between worktape heads and the logarithm of worktape space. 

Proposition 4 . For every e > 0, 

NSPACE(S, m, A+k) c NSPACE (S + (k+l+e)»log S, m, A), 

m 

DSPACE(S, m, £+k) c DSPACE(S + (k+l+e)»log S, m, I). 

m 

Proof sketch . Let M be an (m,j&+k) -machine that accepts within space 

S(n). We wish to design an (m, A) -machine M' that simulates M within 

space S(n) + (k+l+e)»log S(n). 

m 

The first £-1 heads of M can be simulated by the first i-1 heads of 
M' . The position of each of the other k+1 heads of M can be stored by 
M' as the m-ary representation of that position. If these k+1 strings 
are properly delimited, the last head of M' can carry them around and 
access them to simulate all of the last k+1 heads of M. Since only fi- 
nitely many (k+2) delimiting marks are required, a single extra bit in- 
serted every j symbols of the list can be used in conjunction with fi- 
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nite-state memory to locate the marks. Each of these bits is set to 1 
if and only if at least one of the k+2 delimiting marks should be lo- 
cated on one of the next j worktape squares. Since j and k are fixed, 
the precise locations of the marks relative to the bits that are set to 
1^ can be maintained by finite-state memory. The list itself accounts 
for an extra space requirement of (k+l)«log S(n), and the additional 
requirement for delimiters can be kept to an arbitrarily small fraction 
of that by choosing j large enough. 

Clearly, M' is deterministic if M is. n 

Proposition 5 . 

NSPACE(S +k.log m S, m, 1) c= NSPACE(S, m, j&4k+3) , 
DSPACE(S + k-loc S, m, I) c DSPACE(S, m, i-fk+3). 

Proof sketch . Let M be an (m,£) -machine that accepts within space 
S(n) + k.loe S(n). We wish to design an (m,I+k+3) -machine M' that 
simulates M within space S(n). 

If S happens to be easy to compute, then M* can start by stationing 
head A at worktape square S(n) and head B at worktape square S(n) - 
lo^ S(n). 

S(n) 



fr v 'A 

log^ S<n) I 
head B head A 

The worktape of M is conceptually parsed into an initial segment of 

length S(n) - log S(n) and k+1 "pages," each of length log S(n). The 

initial segment will always reside in the first S(n) - log S(n) work- 



51 

tape squares of M 1 . One page at a time can reside in the worktape 
squares of M' delimited by heads B and A. Each page not residing there 
can be stored as a worktape head position, the page being the m-ary 
representation of the position. 

In its simulation, M 1 tries to use I of its worktape heads to behave 
like M'. A record of the current location of each page (resident or 
stored as some head position) and the page currently scanned by each 
head of M is maintained in the finite-state control of M'. When the 
heads of M scan different pages or move from page to page, "paging" is 
required. None of the I simulating heads is moved from its proper loca- 
tion, but the one free head is used (with some help from head B) to 
store away the page that is currently resident. The required page is 
then loaded (again with help from head B) , leaving the head that stored 
it free. 

The simulation for arbitrary S differs in that heads A and B are 

restationed during the simulation according to how much space M has 

actually used. When M has used s' worktape squares, with 

(s-1) + k»log (s-1) < s' £ s + k»log s, 
m m 

head A will be at position s and head B will be at position s - log s. 
Restationing is required only when some simulating head is coincident 
with head A (and scanning the final page) , so a second head is tempo- 
rarily free to help the usual free head to determine whether head B must 
be restationed. (Head A is restationed every time s changes to s+1, but 
head B is restationed only when UL°S S J = U-°8 (s+l)J.) Adjusting the 
pages on restationing is easily managed with some help from the finite- 
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state control. 

Clearly, M 1 is deterministic if M is. n 

Our final basic containment relationship is the well known result 
of [Sav70]. 

Proposition 6 . If log n = 0(S(n)), then 

2 
NSPACE(S) C NSPACE(S ). 
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3. Notions of honesty 

Qualitatively, a function is "honest" with respect to space if it 
can be computed without using space that is too much greater than both 
its argument and its value. It is easy to check that functions of prac- 
tical interest are extremely honest. In fact, all of the common func- 
tions are of the following type. (See [Rit63].) 

Definition . A function f :N -♦ N is linear space honest if 

(bin(k)#bin(f(k))| k e N] € DSPACE(n) , 
where we use the notation bin(k) for the binary representation of k 
(high-order bit first, say). Equivalently, f is linear space honest if 

{l k f 00| k € N ^j € DSPACE(log n). 

Our main goal in this chapter is to discover weak separation condi- 
tions for the complexity classes defined in Section 1; e. g. , we seek a 
generally sufficient condition on S. , S. for the nonemptiness of 
NSPACE(S 2 ) - NSPACE(S 1 ). Well known "gap" theorems, however, show that 
any reasonable separation condition must include some sort of honesty 
requirement on at least one of the space bounds involved. (See [Bor72], 
[Con72], [Con73], [Yng71].) The most commonly used ([Ib72], [Sav70] , 
[BGIW70] , [Bk72]) notion of an honest space bound is the one we adopt. 

Definition . If f :N -» N does not belong to 0(1) and M is a deterministic 
off-line TM acceptor with L(M) = 1 and Space^(x) = f(|x|), then f is 
fully constructable and M fully constructs f . 

Proposition 7 . 

(i) Every fully constructable function is a space bound. 
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(ii) Let f be linear space honest. If log n € o(f(n)), then f is 
fully constructable by a (2,1) -machine. If log n f 0(f (n)) , then f is 
still fully constructable. 

(iii) Let S be fully constructable by an (m,&) -machine, and let M 
be an (m.jfc) -machine. Then L g (M) € NSPACE(S,m,£+l) ; and if M is determi- 
nistic, then L S (M) € DSPACE(S,m,j&+l) • 

(iv) There are fully constructable space bounds in O(log log n). 
(Cf . , Proposition 1.) 

(v) If S is fully constructable by an (m,jfc) -machine and 1 € o(S(n)), 
then S satisfies 

lo^ n - t'lo^ log^ n - S(n> € 0<1>, 
from which it follows that 

log n - S(n) € O(log log n>, 

m 

log n € 0(S(n)>. 

Proof , (i) Let f be fully constructable. Since f(n) £ 0(1), the lan- 
guage 

{0 k l j k | j > 1, k < f(j+2k)} € DSPACE(f) 
is not regular. 

(ii) Assume f is linear space honest and log n € o(f(n)). Every 
language accepted deterministically within space n can actually be 
recognized (cf . , footnote on page 43) within space n [HU69a], so let the 
(2,l)-machine M deterministically recognize {bin(k)#bin(f(k))| k € N} 
within space 0(n). To fully construct f(n), compute according to the 
transition rules of M successively on 

bin(n)#bin(0) , bin(n)#bin(l) , bin(n)#bin(2) .... 
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until bin(f(n)) is discovered, and then convert bin(f(n)) to unary. As 
both log n and log f(n) belong to o(f(n)), this does fully construct 
f(n) for all sufficiently large n; the differences can be handled by the 
finite- state control. With care, the entire program can be carried out 
by a (2,1) -machine. 

If only log n € 0(f(n)), then using a large enough worktape alphabet 
keeps the search for bin(f(n)) smaller than f(n) itself. 

(iii) An acceptor for L_(M) fully constructs space S and then com- 
putes according to the transition rules of M within that space. The ex- 
tra head is left by the first phase to delimit the space used. 

(iv) Define f(n) = min{k| n is not divisible by k} , S(n) = log f(n). 
Obviously S is fully cons true table. Let jt(k) be the number of primes 
smaller than k. The least n with f (n) fe k is the least common multiple 
of {k'| k' < k}, which certainly exceeds 2 n ^ '. Hence, 
jt(f(n)) £ log„ n. According to the prime number theorem [NZ60], 
k/log k € 0(jr(k)); so 

f(n) 1/2 € O(f(n)/log f(n)) 
c 0(*(f(n))) 
c O(log n). 
Therefore , 

S(n) - log f(n) 6 O(log log n) . 

(v) Suppose the d-state (m, A) -machine M fully constructs S. We 
show below that S(n) = S(n + kn!) for every positive integer k whenever 
log n - jt-log log n - S(n) > loe d. It follows that 

log m n - Jt'log^ log m n - S(n) 4 0(1) =» 1 4 o(S(n)). 
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Let S(i,n) be the number of distinct worktape squares visited 
through the i time that M scans an input endmarker on either end of 
the input while computing on input 1 , and let 

Q(i,n) € {<,$} X {l,...,d} x [l,...,m} S(n) x {1,. . . ,S(n)} A 
describe the total state of M at the end of that time. (If there is no 
i t endmarked total state, then Q(i,n) = undefined.) 

For log - I'loe log_ n - s (*0 > l°Sm d > we snow bv induction on i 
that S(i,n) = S(i, n + kn!) and Q(i,n) = Q(i, n + kn.'). That 
S(i,n) = S(i, n + kn!) for all i implies S(n) = S(n + kn.*). 

Since M has a fixed initial state, Q(l,n) = Q(l, n + kn!) and 
S(l,n) = S(l, n + kn!) = 1. 

Suppose Q(i,n) = Q(i, n + kn!) and S(i,n) = SC±, n + kn!). To 
prove Q(i+l,n) = Q(i+1, n + kn!) and S(i+l,n) ■ S(i+1, n + kn!), we 
consider four cases: 
Case 1: Q(i,n) = undefined. Obviously, 

Q(i+l,n) = Q(i+1, n + kn!) = undefined, 
S(i+l,n) = S(i,n) = S(i, n + kn!) = S(i+1, n + kn!). 
Case 2: Q(i,n) is defined, but Q(i+l,n) = undefined. Since n + kn! 2: n, 

the computation continuations are identical. 
Case 3: Q(i+l,n) is defined and involves the same endmarker as Q(i,n). 

Since n + kn! 2 n, the computations are identical from the i 

st 
endmarked total state up to the (i+1) endmarked total state. 

Case 4: Q(i+l,n) is defined and involves the other endmarker. In going 

from Q(i,n) to Q(i+l,n), M first reaches each input square 

j g [l,...,n] in some memory state f(j). Because 



57 

d.m S(n) .S(n)*<n 
is Implied by 

log m n - i'log^ log ffi n - S(n) > log d, 
however, f^) = f(J 2 ) for some jj < J 2 € {l,...,n}. Clearly, 
therefore, increasing the input length by any multiple of j ? -j, 
results in the same next endmarked total state and no new memory 
states. Certainly kn! is a multiple of jo-J-, • □ 

Criteria slightly different from ours for "acceptance within space 
S" have been proposed. Book [Bk72] requires that every accepting compu - 
tation on input x involve no more than S(|xj) worktape squares, and 
Ibarra [Ib72] requires that every computation on input x involve no more 
than S(|x|) worktape squares. The significance of the proof of part 
(iii) of Proposition 7 is that the complexity classes determined by 
fully constructable space bounds are hardly affected by these differences. 

While part (iv) is surprising, part (v) of Proposition 7 redeems 
our intuition that a radix count of the input length fully constructs 
nearly the smallest possible fully constructable space bound. The 
result implies that one may substitute the innocuous hypothesis 
1 £ o(S(n)) whenever the apparently more arbitrary condition 
log n 6 0(S(n)) arises for a fully constructable space bound S. 

Hopcroft and Ullman [HU69a] work with space bounds that are merely 
"constructable." 

Definition . If M is a deterministic off-line TM acceptor with 

S(n) = max{Space M (x)| x € L(M) , |x| ■ n}, 
then S is constructable and M constructs S. 
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An interesting corollary of Proposition 7(v) and the existence of con- 
structable space bounds S(n) £ o(log n) with 1 € o(S(n)) [SHL65] is that 
not every constructable space bound is fully constructable. Because we 
cannot prove Proposition 7(iii) for constructable space bounds, however, 
we choose not to use the concept. 
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4 . Conventional separation results 

Counting and diagonalization arguments ([HU69a] and [SHL65] , re- 
spectively) have been used to prove separation results among the 
NSPACE(S) and DSPACE(S) complexity classes. (See Corollaries 9, 11 be- 
low.) In this section we sketch more careful versions of these arguments 
to show what conditions they yield for separation among the more refined 
classes NSPACE(S,m,j&) and DSPACE(S ,m,l) . For details, the reader is 
referred to [HU69a] , [SHL65], [HU69b]. 

Theorem 8 . If S 2 is fully constructable by an (m,j&) -machine , then there 
is a language over {0,1} in 
DSPACE(S 9 ,m,A+l) 

- (U {NSPACE(S 1 ,m,A)| S^ (n)-2.S x (n) 4 0(1)} U 
U {DSPACE(S 1 ,m,|-l)| S 2 '(n)-S 1 (n) 4 0(1)}), 

where S ' (n) =min{S (n), log n - |«log log n}. 

z i. m m m J 

Proof sketch . Define 

L = {x| x = uyu £ {0,1} for some u with 

S 2 (|x|) 

|u| =min{ L |x|/2j, m Z .S 2 (|x|)*}}, 

i> 
where u is the reverse of string u. (Note here that 

|u| <; m .S 2 '(|x|)*.) 

We first show that L € DSPACE(S 2 ,m,£+l) . An acceptor for L can 
first lay out space S ? (|x|), using the extra head to delimit that space. 
The delimited space can be used as a counter to compare successive char- 
acters from the two ends of the input string. Because I extra heads are 

S 2 (|x|) 
available, the counter is large enough to count up to m •S„(|x|) . 
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Next, we show that L I NSPACE(S 1 ,m,jt) unless S 2 ' (n)-2.S 1 (n) € 0(1), 
By the reasoning of [HU69a] , for a d-state (m,A)-machine to accept L 
within space S_, we must have 



S 9 '(n) , s i( n) i \ 
n 2 »S '(n)* (d.m -S (n)*) 



,2 

m 
2 £ 4 



Taking logarithms twice gives 

S 2 '(n) + j&.log S 2 '(n) + cnstnt x £ 2.(S x (n) + X'log S^n)) + cnstnt 2 , 

so that S 2 , (n)-2.S 1 (n) € 0(1). 

Finally, we use similar reasoning to show that L 4 DSPACE^.m.A-l) 
unless S 2 '(n)-S 1 (n) € 0(1). The behavior of a deterministic off-line TM 
at an input boundary can be described as a function from the storage 
states into the storage states plus the "accept" and "nonaccepting no- 
return" outcomes. For a deterministic d-state (m,jt-l) -machine to accept 
L within space S , therefore, we must have 

So'(n) , S l (n) , N i-1 

m 2 .S'<n)* S.(n) t -l d ' m * S l (n) 

2 £ (2 + d-m L 'S^n)* ) 

Taking logarithms twice gives 

S 2 »(n) + i.log S 2 '(n) + cnstn^ £ S^n) + jt-log S^n) + cnstnt 2 , 
so that S 2 , (n)-S 1 (n) 6 0(1). □ 

Corollary 9 [HU69a]. If S 2 is fully cons true table, then 

DSPACE(S 2 ) - (J {NSPACE(S 1 )J min{S 2 (n), log n} I 0(S ]L (n))} 
contains a language over {0,1}. 

Proof . Take m so large that S 2 is fully constructable by an (m,l)- 
machine. For S 2 '(n) = min{S 2 (n), lo gjn n - lo^ log m n}, Theorem 8 gives 
a language over {0,1} that bears witness to the noncontainment in 
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U {NSPACE(S 1 )| min{S 2 (n), log n} <L O^n))} 

-U{NSPACE(S 1 )| S 2 ' I OCSj)} 

= U CNSPACE(k.S 1 ,m,l)| k f N, S 2 « g 0(8^} 

-U [NSPACE(S 1 ,m,l)] S 2 ' 4 0^)} 

Clj {NSPACE(S 1 ,m,l)| S 2 '(n)-2.S 1 <n) ^ 0(1)} 

i> DSPACE(S 2 ,m,2) 

<= DSPACE(S 2 ) . D 

Theorem 10 . If S_ is fully cons true table by an (m, 1+2) -machine, then 
there is a language over [0,1} in 
DSPACE(S 2 ,m,A+3) 

-U {DSPACE(S 1 ,m,jJ)J S 2 (n) - 2.S x (n) -. A-lo^ S^n) - lo^ n 

«0<1)}. 

Proof sketch . Design a deterministic (m, 4+3) -machine M to operate as 

follows on input ex, where e is the description of a deterministic 

(m , 1) -machine M : 
e 

1. Lay out space S-(jex|), using head A to bound it. 

2. Use I worktape heads to carry out a simulation of M on input 
ex, using head B to bound the simulation. (The simulation re- 
quires no more space than c + S (ex), where c depends only 

e 
on e; and it requires no additional worktape heads to read the 

description of M because that description can be carried around 

and read by one of the & heads already being used.) Meanwhile, 

use head A to keep m-ary count of the simulated steps, and use 

head C to mark the high-order end of the counter. 



simulation (A heads) 
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S-(| ex| ) 
_z__x ■ 



; t " ■'■ J . — r "~! — ' ( J r'A : ' : ' ¥■ ':' ■' . ' " ■ — 

free space J seary> counter [ blanks 



«« U" .! ' ^g" . U' 



head B head G head A 
3. If the sioulation is coif>leted before the simulation and the 
count run out of free space, then coop levant the outcome of the 
simulation; otherwise, just accept. 
Now suppose, H is a deterministic d- state (■. > J)*»achine that accepts 
within space S_, where A(n) { <j(i) for 

A(n) - S 2 (n) - 2«S I (n) - i-log^ S^n) - log^ n. 
Take x so that A(fa*j) <> c ft .- + d. If ex C L0i >', then it nut be accepted 

within d.|ex|-m 'S^lexl )* step* by BT. (Otherwise, a total 
state would repeat, and M would loop forever en ex.) Since 

e ■ •■ .: ■■..;' 

_ .. jt __£ v ■■■*-■' 

c e + 8l C| ex|) + log, (d.| ex| .« V .B^mm) )*) 

- c e + lo^d +S 2 (|ex|) - A(|«|) 

* S 2 (|ex|) - <AC|ex|) - (c e +d) ; ) 

£ S 2 (jext), 
M does discover that ex € L(M e ) and arrange ex |jy$b Qn the other 
hand, if ex 4 L(M # ), then M will certainly accept ex. Bierefore, 
UM e ) *L(M). D 

Corollary 11 fSHL65]. If S 2 is fully coostructaMe, then 
DSPACE(S 2 ) - U {DBEACE<S 1 )| » 2 <n> 4 ^(S^n) -+ log n)} 
contains a language over {0,1}. 

Proof. Take m so large that S_ is fully constrttctable by an (m,l)- 
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machine. Theorem 10 gives a language over {0,1} that bears witness to 
the noncontainment in 

U {DSPACECS^j S 2 (n) g 0(S t (n) + log n)} 

= U {DSPACE(k.S 1 ,m,l)| k € N, S 2 (n) g OCS^n) + log n)} 

-U [DSPACE(S 1 ,m,l)| S 2 (n) g 0(S 1 (n) + log n)} 

cU {DSPACECSj^,!)! S 2 (n) - 2.S 1 <n) - lo gjn S 1 (n) - log m n £ 0(1)} 

i> DSPACE(S 2 ,m,4) 

(= DSPACE(S 2 ). D 

By Proposition 6, one more corollary is implicit in Corollary 11. 

Corollary 12 . If S„ is fully cons true table, then 

DSPACE(S 2 ) - U [NSPACECspl S 2 (n) I O^n) 2 + (log n) 2 )} 
contains a language over {0,1}. 

Remark . The original arguments of [HU69a] and [SHL65] were for S 2 
merely cons true table. For S» constructable by an (m, I) -machine M with 
L(M) c S , accordingly, a witness language over Sx {0,1} is obtained in 
each of the above results. 
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5. Padding whole languages 

For space bounds above log n, the separation results given by 
Corollary 11 are very good. For S 2 fully constructable and 
log n € o(S 2 (n)), in fact, since S 2 € 0^) implies DSPACE(S 2 ) c 
DSPACECSj) (Proposition 3) , it follows from Corollary 11 that 
DSPACE(S 2 ) - DSPACECSj) ^ if and only if S 2 4 0(8^-. Corollary 12, on 

the other hand, is relatively weak and does not even separate NSPACE(n ) 

2 
from NSPACE(n ), for example. 

Using the padding trick of Ruby and P. Fischer [RF65J, Ibarra [Ib72] 

has refined some of the separation results given by Corollary 12. The 

basic trick is illustrated by the following lemma, where we write p(L) 

for {xlO | x € L, jxlO | = p(|x|)} when L c {0,1}* and p:N -♦ N satisfies 

p(n) > n. 

Lemma 13 . If p(n) > n is linear space honest and log n £ 0(S(n)), then 
p(L) € NSPACE(S) » L € NSPACE(S op). 

Proof. Every language accepted deterministically within space n can 
actually be recognized (cf . , footnote on page 43) within space n [HU69a] , 
so let M deterministically recognize {bin(k)#bin(f (k))| kf N] within 
space n. 

(=») Suppose M. accepts p(L) within space S. Design ML to operate 
as follows on input string x: 

1. Write down bin(|x|) and then compute according to the transi- 
tion rules of M successively on 

bin(|x|)#bin(0), bin(|x|)#bin(l), bin(|xj )#bin(2) ,. . . 
until bin(p(|x|)) is discovered. As p(n) ^ n, this can be 
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accomplished within space proportional to log p(| x| ) € 
0(S(p(jx|))). 
2. Compute according to the transition rules of M- on input 

xlO P ^ X ''~' X ' . By hypothesis, this can be accomplished within 
space proportional to S(p(jxj)) in acceptance. 
Clearly, Mj accepts L within space proportional to S op. 

(«=) Suppose M 2 accepts L within space S(p(n». Design M- to operate 
as follows on input string xlO : 

1. Write down bin(| x| )#bin(| xj +I4k) and then compute according to 
the transition rules of M to determine whether | xlO j -» p(jx|). 
This can be accomplished within space proportional to 

log p(|x|) = log jxlO k J € 0(S(|xlO k j)) in acceptance. 

2. If | xlO | = p(|x|), then compute according to the transition 
rules of M„ on input x. By hypothesis, this can be accomplished 
within space S(p(|x|)) = S(|xlO |) in acceptance. 

Clearly, M. accepts p(L) within space proportional to S. G 

The following theorem shows how Lemma 13 is used to improve known 
separation results. The formulation is a variation of Ibarra's [Ib72], 

Theorem 14 . Let sets g_ , g_ of space bounds be given, with 

log n e 0(S(n)) for every S € 8, U » 2 " Say Pj.( n ) > n >*** » P*^ > a are 
linear space honest functions with S. op. +1 € 0(S_ op.) wh*uttver 

1 <; i < i, s t e & v s 2 € s 2 - 

If L € {NSPACE(S 2 p A )| S 2 6 8 2 } - U {NSPACE^ o Pj)) S l € S^, 

then Pi (L) 6 H {NSPACE(S 2 )| S 2 € S 2 ) - U [NSPACE(S 1 )| S x € Sj} for some i. 

Proof. For 1 £ i € £, let 
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C(i,.l) ^UtWyHM^%H^-i*f<^%Ua.^s ~.«i*^ i~^ . 

SO, for 1 i i < J|, , : - >: ; i<|V , ,^, i; ?it ., r , ?09 ,„^ rK - M .. _ 

L € C(i.^ * L € CCt,l) • ; *ois fe .« l2s ^ . .. : .. .r. -v.. J, 

far tbatr na* i. Q. r ..: ••-? <' ; v":>-^c *' (C'bj)q)2 saaqs .ji:.^;-,; 




Tfe« main rembt qfr tfaM ufc^» Wjc , 









ea»::f; 



specific r*a»*$» a€ f^^^ptt^Mlpf^ 

for DSHCB ■*» 



Chapter Two o£ tki* t**«*». 
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6. Program codes and recursion 

For precision, let us now choose an appropriate program coding for 
off-line TMs. With each off-line TM having input alphabet {0,1}, we 

* 

associate a distinct program code from {0,1} ; and we do this in agree- 
ment with the easily-satisfied conditions listed below. We use the 

notation L ' for the set of program codes for (m,t) -machines and L 

p-c. p.c. 

for the set of all program codes. We denote by M the off-line TM with 

e 

program code e. 

Condition 1 . No program code is a prefix or suffix of another, and L m '^ 
p.c. 

is regular for each m, |. 

Condition 2 . For each fixed m, I, there is an (m,i) -machine U (a "Uni- 
versal simulator") with 



L(U Q ) = {ex| e € L m ** , x € L(M fi )}, 

Spacey (ex) < c g + Space^ (x) if e € L m '* , 
e P* • 



r m,X 



where c g depends only on e. Furthermore, U n has only one computation on 

ex if M is deterministic, 
e 

Condition 3 . There is a recursive function f :L -♦ L such that 

p.c. p.c. 
m 9i m 

f :L p'c- ~* L p-c. f ° r each m * l and such that M ff ) deterministically 

writes e at the front of its worktape and thereafter acts according to 

the transition rules of M . 

e 

Most common instruction-by- instruction or state-by-state codings of off- 
line TM programs can be tailored to satisfy these conditions. The only 
trick is to design the universal simulator of Condition 2 so that one of 
the ia 1 simulating worktape heads carries with it and references an 



iijp.u 111 .. ^ * - -m *mnwiimm.mjiiw . _ ^mmmmmBmmimmm* 



68 



appropriate version of the progran code a* ,4A iMPSW*Mr:r^4c4» ie wxtf ,J»- 



low in rhr proof of Thonrini 15.) 

Conditions 2 and 3 allow ns to prove a version of the fixed point 

theorem (recursion theorem) of, r«« urslpo fa n uUwi theory. . 

'■ -"'" -'■-''■ " s - *-- ' 'I.fK sbsjTi 9*g2. 5K58523 3aoi; 



x.«£ ; i-lH sbsti 9»»» ".j»'X»e*» ■Jacriift.u- 1; «sr?o<i. 






aia; 



3c(Speee M (x) £ c ^ Spece^Co^x)). 

,M. Is deteminiatie if M in. 






«izi /k>j&s. ic- 



Froof. Let D be the vniveraal afanlator of r wetflTon 2 for n, i, let f 
be «• in Condition 3, and let e. be i for M. T*ke M to 

be en («,i)-nechii» tbet operate, aar f o j jfann^ t frOjn 5 ** e» ; lt» Input tape 
and e en ita work tape: ■' ■■„ , :f > k ^ ' *«»qs + _a - ±y-»> ^.-^ 






1. Convert e to f<». 



2. Convert f(n) to h(f(e)), nhern hie the "doubling honpmorphian" 
with b<0) - ©&, b(l> - II. 

3. Simulate B Q on e^ffe)*. To do thia, eoneat e 2 to finlte-iiate 
and carry nfffe)] Tound vita one «f the nosstnfe heads 



of U Q . the redondeft t ■ jnliula fti fled to 

■ark the enda of the atria] aai ^n poaitton of the inpwt head 



Let eg » KOj). Aen %y d«fntttion V- flf pijaftjfcf 'hi gfeinava -ott tnpttt : x: 
1. Write e. on the vorktape. 
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2. Convert e to f(e 1 ) = e_. 

3. Convert e to h(e ) . 

4. Simulate U„ on e„e x. 



Thus, 



x 6 L(M e ) » e 2 e Q x £ L(U Q ) 
» e Q x g L(M), 



Space!^ (x) £ c + Space^e^) 
e 
where c is c^ plus the number of worktape squares required for steps 1, 

2, 3. □ 



e 2 
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7. Another general separation result 

The general separation result that we prove in this section (theo- 
rem 18) amounts to a dramatic refinement of the following very weak 
"separation" result. 

Lemma 16 . For no recursive space bound S does NSPACE(S) contain all the 
recursive languages over {1}. 

Proof - If S is recursive, then the diagonal language 

{1*1 l n 4 L s 0t e ), le - bin(n» 
is a recursive language not in NSPACE(S). Q 

One more technical lemma is all we need for the proof of Theorem 18. 

Lemma 17 . If S/2 is fully constructable by a (2,1) -machine, then some 
deterministic (m,*)-machine recognises 

L - {l j k ( k * » S<J) .S<J)*' 1 } 
within space log^ n - (A-l).log log; n. 

Proof. It is easier to get an (m, 1+1) -machine that does the job. Given 
a fixed position s of the extra head, we can use the other I heads within 
space s to count through s " cycles of an m-ary counter that counts up 

S 8 1-1 

to m , while checking whether k < m »s . By trying successive posi- 
tions s, we can find position s , the least sal with k < m 8 »s*" 1 . 

Certainly S is fully constructable by a (2,1) -machine. Since m S 2 
and l-z. 1, we can leave the extra head at position s. and try to lay out 
space S(j) without reaching that position. We succeed if and only if 
k ;> m S(3) .S(j) i_1 . 

Suppose n is so large that 
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(log n - U-l).log log n)*" 1 > (l ogm n)*" 1 /*. 

m mm in 

If 

s > 2 + l ° 8 m n " <*- 1 >« 1 °8 m lo %, n, . ■ • 

then 

V 1 i-i 

m u -(Sq-I) >n = j+k2=k 
by substitution, contradicting the minimality of s fl . Therefore, 

s S 2 + log m n " ( *- 1)#lo8 m ^ n 
for all sufficiently large n, and the simple method of Proposition 2 

yields an (m,i+l) -machine that recognizes L within space 

log m n - (£-l).log_ log n. 
m mm 

To get rid of the extra head, we make two observations. The first 
is that the boundary head can be used in the first phase to run the Di- 
ary Counter without losing its place. The second is that the boundary 
head can be used even to lay out space S(j) in the second phase. The 
reason is that, since S/2 is fully constructable by a (2,1) -machine, S 
is fully constructable by a (2,l)-machine that leaves every other tape 
square redundant by always writing and reading aa rather than just a for 
every worktape symbol a. We can modify redundant tape squares to mark 
the head position and the ends of the used space. □ 

Theorem 18 . If S_ is fully constructable by an (m,l) -machine, then each 
of the following set differences contains a language over {0,1}: 

NSPACE(S 2 ,m,i+3) -(J {NSPACE(S ]L ,m,A+2)| 1 € o^OO-S^n+l))} , 
DSPACE(S 2 ,m,jJ+3) - (J {DSPACE(S ]L ,m,£+2)| 1 € o(S 2 (n)-S 1 (n+l))} . 

Proof . Let S„ be fully constructable by an (m,j£) -machine, and let U_ be 
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the universal simulator oj| Condition 2, for t, |-«. By Proposition 
7(iii), L g (U Q ) 6 MSPACl(S 2 ,«,l+3), end intuitively It ■heat* be" very 

nearly the hardest lsnsaagc in tha* c^^l^n^een. tftatjl*, 0fc4 

RSPACB(S l ,n,|+2) for any apace bound Sj vith 1 € otfj^-S^n+l)). ^* 
Suppose that the (.,*•«) -nachine -^wm^^l^^m^^i^ 

S v where r^e<S^)-l| | tn*i)^ ' r «a#4 ^a^P^^aVtnatf^i : >> > t v. •••;,- v ,' 
iog^ n - A'log^ len^ n - SjC*} jpf4^ai><I~0 ~ n m ~ -I ' - •• 

; " ■* ■ •"• .- else that & -< r -;" v -«M;jI- J a s>&i £!-*;;,#-«' jaiL: si*id;ja»»(lHhi t n; ^-- :il> 

I ■ • • " ■ . ■ . ' 

>/• Ho illii ; i^..t|!t^ltlsp^|^»ePfj| > ajM. ay.,-ha»d ya^'srii io-bi* i-p -.;V 



*J. f> ~? 



I, for e€ l) 



g^feprfi *2 m.-o;^ -m . -i^siq. a?i gnisof ;i« CJ J5iv 







cursive, we can take a deterministic (2,1) suwhine that accepts L within 

•one space hound S/2 that is fully constswctahLB hy * <2,l)-u*cfaine. 

-A-xass o- «||£a-pa ^q»3 .»;:fituwi>K^ % J i host nfc* • W »«'Jnd«?* sm?r^5t V7M-; 

Let S»<n) - n w .S(a)**\ and design an (w.j-tt) nachiae ft» that oper- 

;-r>sf|* h----if -.- ;-* to «fea§ arf3 &oa fioHi:ao<| |b»H 9*53 
ates as follows: 



1 . Check 'that ' the 'input string is of* the fotn n**^ for 



space. j - - ,> -^ v ». .-. > 

2. Deteradne whether k % &(\xjti 9flmmt7 this reeuires no 

"' ^eri-ihaa^ 1 --— C--^ : - •'£• '<"- :uVi ;! .:-?i--:.3afTc-D v/fi?l ad C .Z ■.;?,.. 
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log m | X O k | - a+D.lo^logJxO*! 
s log^ |exO k+1 | - (i+l).^ log ffl |exO k "*| 
^ Sl <| exO k+1 j ) 
vorktape squares. 

3. If k s» S'(] xj ), then compute on Input x according to the transi- 
tion rules of M. This requires no more than 

S(|x|) s log m S»(|xj) - (jt+D.log^ log m S p (|x|) 
<; log^ k - (J+IO.logk log^ k 
£ log m |exO k+1 | - (i+D.lo^ l 0gin |exO k+1 | 
i S^lexO^ 1 ]) 

worktape squares for x £ L(M) . 

k+1 

4. If k < S'(|x|), then compute on input exO according to the 

transition rules of U. , committing the final to finite-state 

k+1 
memory. This requires no more than S. (| exO |) worktape 

squares for acceptance. 

To summarize the behavior of M' on exO , 

k Ss S' (| x| ) =» behave like M on x; 

k < S«(|xj ) => behave like U- on exO k+1 . 
To summarize the timing for exO £ L(M*), 

Space M , (exO k ) «; S^j exO k+1 j ) . 

Applying the recursion theorem (Theorem 15) to M' , we get a program 

code e_ for an (m,i+2) -machine that accepts 

L(M ) = {xO k | e_xO k € L(M')} (= 1*0* 
e U 

within space 

k k 

Space M (xO ) <; c + Space^,(e x0 ) 

e 



iiiii j il . ■■ aim* lii i niHill i ^^^ tl i ,|| | i , jj | ii ipuji, 
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for some constant c. 



■'•i ) 



Claim. For each *uffi«i«tt*iy lj»n* string x (t*^^J the; following hold, 
for ovary k: (\ l ^mmh.c > 

X» € L0f ) •> X € l» . sox&upa /'qaji:;^* 

Proof: "tat y i rtll^tl-io 3 ^ B#t" 1; ^ :> -"^ * l ;it : r " =: A y - 
S 2 (n)-8 l (n+l) i'P$e 



to ao !;.<•? rn,i 



\ i-*" '/ G »J3 € * J * A k : M* 1 - 



for ovary n % fajt| . Vc establish tha claim for x Iqp induction on k 
down from fc % f*(f*f ) Jo- k "ft,... 



k* 8'<fx|>? 

xO k € MH. ) • e^nl* € L0f»> 






a 



.«9(> « 



V 

f -armnmo *^-— * — — ^^aT a \ 









k<S'<|x|): Aaaoma^^Cl^^f^C^ 






k k 

*0 " 



a* sjfjrl. sy&fftui <-- < 



(by choice of"a^j I 

by definition ^toharsi , like t In this 






(because u Q ia universal over -ajjj^) 

-» x € I 



x € L ■» xO^ 1 € LCH. ) 
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(by induction hypothesis) 
=» e xO k+1 € L(M') 

(by choice of e Q ) 
=> Space^ (e xO k+l ) £ S^j e Q xO k+2 ] ) 

(by space usage of M') 

=* c + Space,,. (xO k+1 ) £ c +c 4- Space^,(e xO ) 
e e„ 



"0 



(by choice of e Q , c) 

S c e +0+8^16^^]) 

(because x is so long) 



=> e Q xO k+1 € L S2 (U ) = L(U t ) 

(by choice of U_) 
=> e Q xO k € L(M') 



(because by definition M' behaves like IL in this case) 

=> xO k € L(M ) 
e 

(by choice of e.) . D 
Finally, M can be modified to use its finite-state control to re- 

e o 

* 
ject padded inputs (those not members of {1} ) and to agree with M on 

short ones (those not sufficiently long for the claim) without using the 

worktape. This gives an off-line TM that accepts L = L(M) within space 

S_ (j e_j +n+l) . Because 

S 1 (|e |-fn+l) € O(S 2 (|e |-tn)) 

cO( S S (n«)), 
n's;2n 



iwwm>m^wwmwwm.wm uu ii i i j i ii i .hi i i. i nmnwmm& -mmmmvu m . .. ■ <^"^" -^ 
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Proposition 3 gives L € HSPACS< m-Agi*l&*-*<m*dbdt f*) was chosen 

***** i+* 

arbitrarily, and by T mssm 16 not every such recursive -1 1: {1} can be- 

long to the particnlar class RpP*CB( £ S»j@| f >). * contrsdiction. 
A startler proof shows that ■'"•< 8 >4 lo ftg»s«? a>3«cc *fa) 

where y coa»^« a^^ing to the tranaitin. «1« of <| in ***•*»*- 



nistic cowaettattoaa bot halts itfel* ■ ii i issllag Wh ss i i v i r 3^ would take 



stic stew. O " 



.■J) J » (-.0) ,J> ^"Ox s 



Hr ' 




y 




*.' 


i 9^iOi 


'« '*;_•-'■ i 




( 


M)J $ 





m^iti-aJ lal> ¥<i ^-^f--.> 



'»3 






?-**4«S>^ *V*- *£t«£5} 3'S.Wf: b3 *:■■-. ..'-5 :r>'~f; 

- iff awii-^io- -ns e.sr.'c^ aiti -j« !v 'i" 
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8. Applications of the general separation results 

Our first application brings together Corollaries 9, 11, and 12 
with the related consequences of Theorem 18. It is the latter (part 
(iii) of Corollary 19) that subsume and improve on the specific results 
of [Ib72]. 

Corollary 19 . Let S 2 be fully cons true table. 

(i) -If S 2 (n) € 0<log n), then DSPACE(S 2 ) <£\J [NSPACE^) | S 2 <? O^)}. 

(ii) DSPACE(S 2 ) <£U (DSPACE^)] S 2 tf O^)}, 

MPACE(S 2 ) <*U {NSPACECS^l S 2 « OCSj 2 )}. 
(iii) NSPACE(S 2 ) <t\J {NSPACE(S 1 )| S 1 (n+1) € o(S 2 (n))}, 

U {USPACE(S 1 )| S 1 (n+1) <E 0<S 2 (n)), S^n) 6 o(S,(n))} g NSPACE(S 2 ), 
(In the case S 2 (n+1) 6 0(S 2 (n)) , note that S^n+1) € 0(S 2 (n)) is 
implied by S^n) € o(S 2 (n)).) 
Furthermore, there are languages over {0,1} that bear witness to these 
facts. 

Proof, (i) This part is a slightly weakened form of Corollary 9. 
(ii) By Corollaries 9, 11, and 12, we can take languages 

L 00' L 01* L 10 c t ' 1 } such that 

L^ € DSPACE(S 2 (n+2)) - y {NSPACE(S 1 (n+2))| min{S 2 (n), log n} £ 

O^n))}, 
L Q1 6 DSPACE(S 2 (n+2)) -U {DSPACE(S 1 (n+2))] S 2 (n) £ 

0(S 1 (n) + log n)}, 
L 1Q € DSPACE(S 2 (n+2)) -U {NSPACE(S 1 (n+2))| S 2 (n) £ 



0(S 1 (n) 2 + (log n) 2 )}. 



Clearly the language 
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[00x| x € L Q0 } U {01x| x € L Q1 } U {10x| x € \ Q ) 
belongs to DSPACE(S 2 (n)) but not to 

U {NSPACE(S 1 (n))| min{S 2 (n), log n} 4 0(S ]L (n))}, or 
U [DSPACE(S 1 (n))| S 2 (n) 4 0(S 1 (n) + log n)} , or 
U [NSPACE(S 1 (n))| S 2 (n) 4 OCS^n) + (log n) )}. 
(Cf., Lemma 13.) It is easy to verify that 

S 2 4 0^) => min{S 2 (n), log n} tfO^n)) V 

S 2 (n) 4 0(S 1 (n) + log n) , 
S 2 4 0(S X 2 ) => min{S 2 (n), log n} 4 0(S 1 (n)) V 

S 2 (n) 4 0(S 1 (n) 2 + (log n) ). 
(iii) Take m so large that S 2 is fully constructable by an (m,A)- 
machine. Theorem 18 gives a language over {0,1} that bears witness to 
the noocoatainaent in 

U {NSPACFCspf Sjdi+1) € o(S 2 (n))} 
-U {NSPACE(k*S lf m,3)[ kfN, S 1 (n+1) € o(S 2 (n))} 
»U {NSPACE(S 1 ,m,3)j S 1 (n+1) € o(S 2 (n))} 
cU {NSPA€E(S 1 iffl,3)| 1 € ^(ny-S^n+t))} 
i> NSPAeE(S 2 ,m,4) 
CNSPACE(S 2 ). 

Containment in the second assertion of part (iii) holds by Proposi- 
tion 3. To prove that the containment is proper, appeal to the first 

■ft 
assertion to get a language L c [0,1] in 

NSPACE(S 2 (n+2)) - U {NSPACE(S 1 (n+l))| S^n+1) €0(S 2 (n)), 

S x (n) € o(S 2 (n))} 

and then apply Theorem 14 with 
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S l * C s x l S i< n+1) € 0(S 2 (n)), S 1 (n) € o<S 2 (n))}, 

» 2 = C s 2 )' 
p x (n) = n + 1, 

p 2 (n) = n + 2. O 
Examples . For any function G tending to infinity (1 € o(6(n))), however 
slowly, 



NSPACE(log n/G<n)) c NSPACE(log n) , 

2 2 

NSPACE((log nr/G(tt)> £ KSPAGE((log n) ), 

2 2 

NSPACE(n /G(n)) 5 NSPACE(n ), 

NSPACE(2 n /G(n)) £ NSPACE(2 n ) , 

»n 2 n+l 

NSPACE(2* ) c NSPACE(2 ). 

Feldman and Owings [F0731 have observed that deterministic linear 
bounded automata are more powerful than deterministic linear bounded 
automata with a fixed worktape alphabet; i. e. , 

DSPACE(n,m) gDSPACE(n). 
Our next application generalizes that observation, showing, for example, 
that it holds even for nondeterministic linear bounded automata. 

Corollary 20 . Let S be fully cons true table. 

(i) If S(n) e o(log n), then NSPACE(S,m) j> DSPACE(S). 

(ii) DSPACE(S.m) gDSPACE(S). 

(iii) If S(n+1) € 0(S(n)) and 1 € o(S(n)), then NSPACE(S,m) pNSPACE(S). 

Furthermore, there are languages over {0,1} that bear witness to these 

facts. 

Proof, (i) Take m so large that S is fully constructable by an (m,l)- 



l il B IPtflp I ^^ 
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machine. By Proposition 1, Ma) <; eflog lefc tiK soC Ifcoer oa p gives a 
language over {0,1} that bears witness to the noaawnrsf nawa^ta ~ ? 
NSPACE(S,«) C NSPACl(8,n+l,l) ,f ra / q 

^ D6PAC«(3.S,«+1,2) a -•£ + c - (^ m 

(ii) Part (1) handle- the case S<n) € o(1o(b), w aiitae ., . 

S<n) 4 o(log n). *ak* «*« large ffcgj^ > ^f^| fj^fp^f^^ 
(«,l)-na chine and S<n) - l^^^^s ^ tj ^^ ^li^pf)^.!! ** 

a language over {0,1} that bear. wlti^^^^.a^^n.MVlWt ^ 

.-,.-■■ e/' '-■ 

,(*£)33Aft2a £ {-(ij) »\"S:) 3 :>«,-'• 

cD8PaCt(S). " 

-' CUD m*'WW&&%MWi**imt &&UUmU by « (.,1)- 
-echin* -<*batirfc»^r^ 
large that 1 € o<k.S<n>~SC«*ttff theOt* fcv^V'iengW *&* f #,if 

that bear, witnea. to the proner ■..■■I.eneaiT -ft>«**» 5 <».a)30A«n>a 

; . j t .,„-.~t ?! p hftS>f[ft«»rt "'iffT'tf aiaaifii'ffl-r^J&.Ds&is 10I navs 2i-.!> 



£f DBPACg<4*S,«rt4,4) I+ff 



Eaojiyot 






es . NSPACEdog.; ^flfl »™- ViW , -, , 



NSPACE<n,«) ^ITSPACKn), 



^attifaW: 

•■"• ■'-'.■ ••-,-r.-;lv -363d isjri- fI,Cr] lave a$gj»C38ftJt «3» &'xm''3 .■t's'^-.r.-jr'lstj^ 
Ibarra [Ib73a] has shown that IHSU»Cfc) C BfflttM<k«), ettere 

DHEADSQc) (NHKADS(k), respectively) donate* the claas of languages over 

{0,1} accepted by «l«terntoi»tic CaoodeWre3aliw ) tnvwr 
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finite automata with k -z. 1 heads. Hie fact 

NSPACE(log 2 n, m) 5 NSPACE(log n) 
is just what is needed to establish a similar hierarchy theorem for 
NHEADS. To this end, we prove a lemma relating NHEADS to NSPACE(log n) 
and DHEADS to DSPACE(log n). 



Lemma 21 {Ha72]. 



k 



»k 



NHEADS (k) c NSPACE(log 2 n, 2 , 1) C NHEADS (k-t4) , 
DHEADS (k) c DSPACE(log 2 n, 2 k , 1) C DHEADS (k+4). 

Proof. Let M be a two-way finite automaton with k heads. A (2 ,1) 
machine M' can simulate M by behaving like a "k- track" (2 , 1) -machine , 
using the respective tracks of its worktape to hold the binary represen- 
tations of the positions of the k heads of M. Clearly, MV is determi- 
nistic if M is. 

log 2 n 



"*> 



k< 



bin (position of head 1) 



bin(position of head k) 



blanks • • • 



To 



t 

worktape head 
(at rest) 

Let M' be a (2 k ,l) -machine that accepts within space log 2 n. 

simulate M* , a two-way finite automaton M can encode each of the k 

"'"Two-way finite automata with k heads can be described as off-line 
TMs that do not use their worktapas but that have k, two-way read-only 
input heads. We assume the k heads cannot detect each other, but nothing 
we say here actually depends on that convention. 
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"tracks" of the worktape of M' as a head position whose binary represen- 
tation is the track contents. An additional head, head A, can keep count 
of the position of the worktape head of M*. 

To read the contents of track i of the worktape square M* scans, M 
begins by positioning head B coincident with head A and head C coinci- 
dent with the head whose position encodes the contents of track i. 
(This requires help from head D since the heads cannot detect each other.) 
Then heads <3 and D are used to successively halve the position that en- 
codes track i (dropping remainders), while decrementing the position of 
head B once for each halving. The remainder of the last division before 
B reaches the endmarker is the contents of track i of the worktape square 
scanned by M*. 

To change the contents of track i of the worktape square M' scans, 
M begins by positioning head B coincident with head A and head C on the 
first input tape square. Then heads C and D are used to successively 
double the position, while decrementing the position of head B once for 
each doubling. The position that is reached when B reaches the end- 
marker is the power of 2 which must be added or subtracted from the 
position encoding track i. D 

Corollary 22 . NHEADS(k) c NHEADS(k+2). 

Proof . For each k, Corollary 20(iii) guarantees the existence of some 
k' with 

NHEADS(k) c NSPACE(log 2 n, 2 k , 1) 

c NSPACE(log 2 n, 2 k ' , 1) 

cNHEADS(k'44). 
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According to [Ib73a] this is enough. □ 

Recently, Ibarra and Sahni ([Ib73b], IIS731) refined some specific 
instances of our Corollary 20 to show that a single additional worktape 
symbol sometimes helps. The following more directly proven corollary 
generalizes their results. Note that this is a case where the conse- 
quences of Theorem 18 are stronger than those of Theorem 10 for determi- 
nistic machines. 

Corollary 23 . Let S be fully cons true table, 
(i) If S(n) € o(log n), then 

DSPACE(S,m) c DSPACE(S,m+l,l) 
for all sufficiently large m. 
(ii) If S(n+1)-S(n) € o(S(n)), then 

NSPACE(S,m) g NSPACE(S,m+l,l) , 
DSPACE (S ,m) 5 DSPACE(S ,m+l , 1) 
for all sufficiently large m. (If S is actually linear space 
honest and log n € o(S(n)), then m = 2 is sufficiently large.) 
Furthermore, there are languages over {0,1} that bear witness to these 
facts. 

Proo f. Take m so large that S is fully constructable by an (m,l) -machine. 
(If S is actually linear space honest and log n € o(S(n)), then m = 2 
will do, according to Proposition 7(ii).) Take rational numbers 6^ 6 2 

with 1 < 6, < 60 < log (m+1). (Note then that 6,»S is fully construc- 
1 e. m *■ 

table by an (m,l) -machine, too.) 

(i) By Proposition 1, S(n) 4 o(log log n) , so Theorem 8 gives a 
language over {0,1} that bears witness to the proper containment in 



- ■ > .- •.H^ ^m mm t/m i imgf f m^mm i mm^mm 
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DSPACE(S,m) c DSPACE^^S^l) 

C DSPACE(S,e+l,l). 
(ii) Fro. S<n+1)-S(n) £ o<S(n)) and Sin)* 0(1),, it is easy to show 
that 1 6 o(S(n)) and hence that 1 € oj[<6 4 «S(ii)-fi.*S(&H)). Therefore, 
Theorem 18 giyes a language over {0,1} that bears witness to the proper 
containment in 

NSPACK(S,m) c NSPACE^.S ,«,3) 
c KSPaCB(6 2 *S,a,4) 
c HSPACE(S,a+l,l). 
The proof for DSPACE is identical. D ' 

v * 2 "* Y/» 
Examples ; Within each of the space bemads /^sg^-pX » H , 

3 2 n l/2 "'*'" s>tXil " /f ' r 

n ' -log log n, 2 , every addi tion s ! ,»OJftSan* symbol increases the 

confuting power of nondeteminisytc jand. jj i r»pninl» t?ie <M^W»a ™«- 

Finally, w« «o on* »t«» fnreher and **■* t^^ rtt tttone lr worjjtape 

heads sometime* increase mm**&^t9m9^4lK<W:>*y "• 

Corollary 24 . Let S be fuflf 'entttMEtJfffr - ^ ; 
(i) If S(n) € o(log n) , then 

DSPaeE<s,n*D ^mmmt*m) .,i- a ?- 
for all. sufficiently large aand all 'A-^-r* •;,,-,..■ ? 
(ii) If «-(att>-3-fa) € 0(log S(n)> and J,<€ o(&(a» , then 
HglsjeE(S,*>4> £MSPAC*<S,«), ■-, 
DSPACK(S,«,1) c DSPACE (S,m) 
for all sufficiently Urge n and, all -^ Jli^ 4a ( ac^sa]^r linear 
space honest and log n € o(S(n», then av,- 2.4a sufficiently large.) 
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Furthermore, there are languages over {0,1} that bear witness to these 
facts. 

Proof . Take m so large that S is fully constructable by an (m,l) -machine. 
(If S is actually linear space honest and log n € o(S(n)), then m = 2 
will do, according to Proposition 7(ii).) Look at any jj. 

(i) By Proposition 1, S(n) £ o(log log n) , so Theorem 8 gives a 
language over {0,1} that bears witness to the proper containment in 
DSPACE(S,m,J) c DSPACE(S - (1/2). log^ S, m, *-t4) 
G DSPACE(S,m,*+6) 
c DSPACE(S ,m) . 
(Directly adapting the proof of Theorem 8 would give 
DSPACE(S,m,i) c DSPACE(S,m,*+3).) 

(ii) Take c > so large that S(n+1)-S(n) <: clog, S(n). Since 
1 € o(S(n)), Theorem 18 gives a language over {0,1} that bears witness 
to the proper containment in 

NSPACE(S,m,|) c NSPACE(S - d.log S, m, l+lcJ+4) 
GNSPACE(S, m, i+Lcj+5) 
c NSPACE(S,m), 
where c < d < |_ C J + 1- (Note that |_cj = if 
1 € 0(1 - (S(n+1) -8(^)710^ S(n)).) The proof for DSPACE is 
identical. □ 

Examples . Within each of the space bounds (log, n) 2 , n 1 , n, 

1/2 
n»(log 2 n) , every five additional worktape heads increase the comput- 
ing power of nonde termini stic and deterministic off-line TMs. Some 
greater number of additional worktape heads increases computing power 
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within space n«log„ n. 
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9. Witness languages over a one-letter alphabet 

The witness languages provided by the general separation results 

above are subsets of {0,1} . In this section we investigate conditions 

* 
for the witness languages to be subsets of just {1} . For sublogarithmic 

space bounds (Theorem 8), we know of no such conditions; but both 

Theorem 10 and Theorem 18. can be modified to give languages over just 

Theorem 25 . If S 2 is fully constructable by an (m,j&+2) -machine, then 
there is a language over {1} in 

DSPACE(S 2 ,m,i+3) - U {DSPACE^.m.A)] 1€ 

o(S 2 <n) - 2.S x (n> - i-log^ S 1 (n) - log^ n)} 

Proof sketch . To adapt the proof of Theorem 10 and get a diagonal lan- 
guage over just {1}, we must, in limited space , somehow obtain a descrip- 
tion of an (m,i) -machine to simulate on the input 1 . Furthermore, each 
description must arise for infinitely many n. (We cannot get by with 
the condition of Theorem 10 because that would require each description 
to arise for a string of every sufficient length.) Because S 2 (n) s 
log. n in the nontrivial caaftjoA suitable approach is to obtain the de- 
scription from the m-ary representation of the input .length (e. g. , by 
dropping the low-order 0's). □ 

Theorem 26 . Let f(n) € 0(n) - 0(1) be nondecreasing and linear space 
honest. If S- is fully constructable by an (m,jt+2) -machine and 
log n € o(S 2 (n)), then each of the following set differences contains a 
language over {1}: 
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NSPACE(S 2 ,m,jJ+6) - U {NSPACECS^m.jOj 

S 2 (n) - S 1 (n + f(n)) * 4'log^ n}, 
DSPACE(S 2 ,m,146) -U {DSPACE(S 1 ,m,l)| 

S 2 (n) - S^n + f(n)) s 4-lpS. n}. 

Proof . Let f':N -* N be the strictly increasing function with range 
{n| f(n) > f(n-l)). Define injections g, h:{ 0,1} : -» N by 

bin(g(x)) = lx, 

h(x0) = h<x) + f (h<x)> , 

h(xl)-f(« 8(xl) )-K- 8<Xl) -1, 

h(\) - f'(m) + m - 1. 

Bse the fact that f(n) € 0(n) to take j so large that h(xO) ac j«h(x). 

Note that, because f is linear space honest and f(n) € 0(n) , the conver- 
v 

sion of 1 to xlO (or, more conveniently, something like 
xl4bin(k)) can be accomplished within space proportional to log n. 



Claim 1 . The result of this conversion requires only space 

Ior n - G(n) 
for some G with 1 € o(G(n)). 

Proof . Because f is nondecreasing and unbounded , we can take some G^ 
with 1 6 oCGjOOy such that ; ; ; m>- it 

hCxlO^ a h(xl) +k.G 1 (k).f(h(xl)) 

a k.GjW.fCMxl)) 

* k.G 1 (k).f(f(m 8(xl) )) 



i k.G.Ck)^ 



g(xl) 



Therefore , 

log m h(xlO k ) 2: log m k + log^ G^k) + g(xl) 
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* log^ k + G 2 (k) +| xl| + G 3 (| xl| ) 
a (log k + | xl| ) + G(h(xlO k » , 



m 
where 

G 2 (n) = lo^ G 1 (n), 

G 3 (n) = min(g(xl)-|xl|| n = |xlj}, 

G(n) = min{G 2 (k)4G 3 (|xlj)| h(xlO k ) a: n} 

hCxlO 1 *) ,Jc 
all tend to infinity. The result of the conversion from 1 to xiu 

requires only space | xl| + loe k, so the claim follows. □ 

An additional worktape head can be used to separate xl from the m-ary 
representation of k, and additional space log n can provide for an m- 
ary counter up to k. 

Let S 2 with log n € o(S 2 (n)) be fully constructable by an (m,i+2)- 
machine, and let U_ be the universal simulator of Condition 2 for m, 1+2. 

* 

Design an (m,jJ+5) -machine U ' to operate as follows on input y € {1} : 

1. Find x with l h ^ x * * y if it exists. 

2. Compute on x according to the transition rules of U Q . 

By the considerations above, whenever step 2 alone uses more space than 
the conversion of step 1 (and S^hCx)) is enough space since log n € 
o(S 2 (n))), the whole program cfcrf be carried out at the extra cost (over 
just step 2) of the three additional worktape heads (one to separate the 
parts of the representation of x, one to separate the entire (left- 
adjusted) representation from the rest of the worktape, and one to scan 
the representation) plus 2.log, h(x) - G(h(x)) worktape squares. By 
Proposition 7(iii), L g (U ') € NSPACE(S 2 ,m,A-t6) . We prove that 

L„ (U') 4 NSPACE(S 1 ,m,jt) for any space bound S x with 
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S 2 (n) - SjCn + f(n)) 2: 4.1og ffl n. 

Suppose the (m, 4) -machine U' accepts L„ (U Q ') within space S., 

where S 2 (n) - S.(n + f(n)) 2: 4»log. n. Because log n g o(S 2 (n)), it is 
no loss of generality to assume also that S. (n) i log 2 n. To summarize 
the behavior of U- * , 

L <V> =L s 2 <V )cL <V> 

and, for e € L m ' i+2 , 
p.c. 

2'log^ h(ex) - G(h(ex)) + c fi + Space^j (x) « S 2 (h(ex)) =» 

e 

Spacey ,(l h(ex) ) * S 1 (h(ex)). 

Finally, design an (m,|+2) -machine U. to operate as follows on 
input x € {0,1}*: 

1. Compute the m-ary representation of h(x). 

2. Simulate U x » on l h ^ x \ o 

If enough space (S 2 (h(x))) is used, then the: extra cost (over just the 
computation by V^ directly on 1 ^ x ') is n%*erjt *t*an 2«loe h(x) work- 
tape squares (half for an m-ary representation of h(x) and the other 
half for an m-ary counter up to h(x) to k^ep {bcack of the input head 
position on 1 W ) plus the two additionftlnWDrfetape heads. Hence, 
L(U t ) ~ {x| l h(x > € L^')} 

= {x| l h(x) € L g (U Q ')} 

c £x| l h(x > € L(U ')} 
- L(U Q ) ; 

and, for every e f L , 

p.c. 

2.1og m h(ex) - G(h(ex)) + c g + Space M (x) s S 2 (h(ex)) =* 
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Space., (ex) s: 2, log h(ex) + S_(h(ex)). 

■to 
For any recursive L c {1} , we can use U- just as in the proof of 

Theorem 18 to get an (m, 4+2) -machine M with 

e 

. fx 6 L, if k * S'(|x|); 

x(T € L(M ) » < ... 

e (e xO K+1 € L<U X ) , if k < S • (| x| ) ; 

Space M (xO 1 ^ S d + 2-log^ h( e() xO k+1 ) + S^^xO*** 1 )), if 

e k 

xQ K € L(M ) 

e o 

* 
for some appropriate space bound S', some constant d, and every x € [1] 

(This uses S-(n) i log- n.) 

* 
Claim 2 . For each sufficiently long string x € {1} , the following 

holds for every k: 

xO k € L(M ) » x € L. 

e o 

* 
Proof . Let x € {1} be so long that 

G(n) x 2.1og o j + c e + d 

for every n 2 h(e fl x) . We establish the claim for x by induction on k 
running down from k i S' (| x| ) to k = 0. 

k*S'(|x|): 

xO € L(M )«xgL immediately. 

e o 

k<S f (jx|): Assume x0 k+1 e L(M ) o x € !■• 

e o 

k k+1 

xO € L(M e ) =» e Q xO K+i e L(U X ) C L(U Q ) 

=> x0 k+1 € L(M e ) 

=> x £ L. 

k+1 
x e L =» xO € L(M ) 



^Bgl!m m9mm\mmMMm^l^WiW^ , * - m w ** ** mmmMmmmm>*m mwwwMmmmm^ urn - - ' 
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Space,, (xO k %^#*^l^*^^^*^«^« )> 



e 
±2 



.1^ k(v n - atitfPtyf^m^ V*> 



BWWO 



* 4-loa MojO** 4 ) - ^CejtfT* 1 ^ * t~l»* J + e + d 



+ Wf#ff^ i .(^O.lS^O^nJ " 0** 



(Inkkm xls to long) G~ 

* s-ChCogSfl* 41 )) 

» SfaCO_ (O^aS^*) < • 






* afl* € L0L >- D 

^O ;« ^fSVS) 'TO..' efclotf 

If H Is a noneaereasiag recursive fomtios so #f^f flff) jr 3 '• ■ 

My) * itfM ) *** •" y € {0,13*, the* ciei» * .*£**• y» ibuootag for 

; ' ■ • >«b3 gaol es arf-: -{1} 5-x 5aJ * *95^;1' 

every sufficiently long x € L: 

SpecOg (x) « d + 2-log^ h(« «0) + 8^(0^) 

* d + 2.10^ j + 2^f^ fcjs^l .jj ^M^^-^fl^Attrr 



■0 



n'*a<2.|x|) ^ 



i'TSj 



It follow, that L € ra*CK io !J> ^O^S: J %i««2%?*l" a^ J^&ary* re- 

n'^(%&) ■ f4 ,j 

cursive language over {1}, this coatradi^if IMHM 16* 

As in Theorem 18, a stellar proof works for ^msf. D 
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Remark . The proof of Theorem 26 does not really require f to be linear 
space honest. It is enough to be able to compute f within space belong- 
ing to o(S 2 ). If S 2 happens to be linear space honest, for example, 
f(n) = log S(n) will work. 

For the particular function f defined by f (n) = 2n, we can get a 
result that extends all the way down to O(log n). 

Theorem 27 . Let S 2 (n) be fully construe table by a (2, 4) -machine, 

1 6 o(S 2 (n) - log 2 n), 1 ^ 3. Then each of the following set differences 

contains a language over {1}: 

NSPACE(S 2 ,2,jt+l) - U [NSPACE(S 1 ,2,4)| 1 € o^C^-S^n))], 
DSPACE(S 2 ,2,jt+l) - U {DSPACE(S 1 ,2,X)| 1 6 o(S 2 (n)-S 1 (2n»}. 

Proof . Define an injection h: (0 + 1) 01(1*0*) -» N by 

hCeOlxO 1 *) = 2 k »3 j .(6i +1), 
where 

* € {1}*, 
lx = bin(i) , 
le = bin( j) . 

Note that, with care, conversion of i h ( e01x( O to ( the reverse of ) 

k V- 

eOlxO can be accomplished within space log 2 h(e01x0 ) by a (2, 3) -machine 

that leaves a worktape head marking each end of the string; this will 

account for the requirement |2 3, 

Let U Q be the universal simulator of Condition 2 for 2, I. Design 

a (2, I) -machine U Q ' to simulate U on the input e .l h ( 01x0 ) when it 

receives the actual input 1 h ( e01x0 ^. Because h(e01x0 k ) Ai(01x0 k ) is an 
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integer that depends only on e, this can be done at the extra cost of 

only d worktape squares, where d depends only on e, whenever at least 

® 1c. 

space log, h(e01x0 ) is used (so that e can be computed from 1 } ). 
By Proposition 7(iii), L g (U Q ') € NSPACE(S 2 ,2,J+1). We prove that 

L (U '). i. NSPACE^,^,*) for any space bound Sj with 1 € o(S 2 {n>-S 1 (2n)), 



'2 



Suppose the (2, A) -machine U* accepts Lg (U ») within space ' Sj, 



2 



where 1 € ©(SjOO-SjC^)). Because 1 € o(S 2 (n) - logj n), it is no loss 
of generality to assume S.(n) s logg n. To summarise the 

behavior of U ' , 

and, for e € L*'* and x € {1}*, 
p.c. 

■ax{log 2 h(e01xO k ), d ft + c e + Spacejj (1 h < 01art ^>)} s S 2 (h(e01x0 k )) => 



Space,, 



(1 h(e01xoS ) ^ Si(h(e01x0 k )) . 



Let L c {1} be any recursive language over {1}. Because L is re- 
cursive, we can take a deterministic (2 , 1) -machine M that accepts L 
within some space bound S that is fully constructable by a (2,l)-machine. 
Design a (2, A) -machine M* that operates as follows on the input string 1 : 
1. Use heads A, B, C to write down (the reverse of) eOlxO with 
x € {1} > h(e01x0 ) = n, if possible. This requires no more 
than logj h(e01x(T) s S 1 (h(e01x0 + )) worktape squares. 



2 A 
Check that e € L » and then erase all but x and 
p.c. 



k 



o k 



blanks* •• 



t f 

head A head B 
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Within the space occupied by x (for x sufficiently long) , use 
heads A, B to compute a version of bin(|x|) that has every 
second and third tape square redundant. (Cf • , proof of Lemma 
17.) As in the proofs of Proposition 4, Theorem 15, and Lemma 
17, one of these sets of redundant tape squares can be used to 
mark the two ends of the string so that it can be carried 
around and referenced by head A without confusion. The other 
set can be used as a binary counter up to |x| . 



o k 



redundant bin(|x|) 



blanks* •• 



t t 

head A head B 

4. Use head A in an attempted full construction of space S(|x|) in 
the additional space occupied by . All necessary input data 
can be obtained from the redundant version of bin(| xj ) . There 
is success iff S(|x|) £ k. 

5. ■ If S(]x|) £ k, then use head A to erase the tape out to head B 

except for the redundant version of bin(|xj), and then compute 
as M would on the input x. This requires no more than 

S(|x|) + |x| ^ k + |x| 

k+1 
£ log 2 h(e01x0' ) 

«£ S 1 (h(e01xO k+1 )) 

worktape squares. 

6. If S(|xj) > k, then completely erase the tape out to head B, 
freeing all I worktape heads, and then compute as U. ' would on 

the input 1 ( e01x0 ' (which is just twice the length of the 
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k+1 
actual input). This requires no more than S 1 <h(e01x0 )) 

worktape squares for acceptance. 

To summarize the behavior of M' on 1 , 

k 2 S(jx|) => behave like M on x; 

k < S(| x| ) *» behave like uy on i b < e01x0 -- > . 

Forl^^eKM'), 

Space Ml (l h(e01x ° k) ) * Sl (h(e01xO k+1 )). 

The recursion theorem (Theorem 15) does not apply as stated, so we 

adapt it. Let e. be the program code for M'. Take M to be a (2,j&)- 

hOlxO*) Cl 
machine that operates as follows, given 1 . ' (where x £ {1} ) on 

2 * 

its input tape and egL on its worktape: 

1. Convert e to f(e), where f is as in Condition 3. 

* 4 

2. Convert f(e) to the string y € .{1} of length 3 J , where 
bin(j) - l.f(e). 



,h(f(e)01xO k ) 



3. Simulate U Q on e 2 »l v v «=/»**" / p Tb Ao this, commit e to 

finite-state memory and carry y around with one of the worktape 

heads of U., modifying symbols of y to mark the ends of the 

string and the position in y that indicates which, if any, of 

^ oJ 4 * ^(OlxO*) „. ■ ' ,h(f(e)01x0 k ) „ . 
the 3 J copies of 1 v ' that compose 1 v * ' ' U Q is 

currently scanning on its input tape. 

v 

Let e_ = f(e.). Then M operates as follows on input 1 ' , where 
U 1 e Q 

, ,* 
* € {1} : 

1. Write e 1 on the worktape. 

2. Convert e_ to f(e-) = e_. 
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3. Convert e_ to the string y € {1} of length 3 , where 
bin(j) - le Q . 

, , t, -hCe.OlxO 15 ) 

4. Simulate U Q on e 2 «l v 

Thus, 

^(DlxO*) € L(M ) « e .l h < e 01x()k > € L(U Q ) 

6 ° k 

ol h(e 01x0) €L(M , )f 

,,11(01x0*). ^ . «. ano ,h(e OlxoV 
:«. (1 ') s c + Space^u J, 



e 



Space 

where c is c plus the number of worktape squares required for steps 
e 2 

1, 2, 3. 

* 
Claim . For each sufficiently long string x € {1} » the following holds 

for every k: 

l h (° lx ° k > € L(M >»*€L. 

e o 

Proof . Let x € {1} be so long that 

S,(n)-S <2n) ;> d +c +c 
z l e 

for every n s h(e Q 01x). We establish the claim for x by induction on k 
running down from k 2: S(| x| ) to k = 0. 

k* S(|x|): 

l h < 01x ° k ) € L<M ) « l h ( e 0° 1X ° k) € L<M') 

e o 

r 

« x € LOO = L- 

k+1 
k < S(1x| ): Assume i h < 01x0 > € L(M ) » x € L. 

e o 



^(01x0*) € L(M } ^ 1 h(e 01x0 k ) € L(MI) 



e o 
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k+1 

=*i h(e o olx0 > euoy) cL(n fl ') 

. l h < 01X ° k+1 > € L(M ) 

e o 

=» x € L. 



€ L » !M01xO k+1 ) 

k + l ^ 

* l h(e 01x0 > 6 L(M.) 

k+l 
=» Spac^, (l h(e 01x0 *) £ S 1 (h(e () 01xO k+2 )) 



Jc+1 N 



=»maxClog, h(e.01xO k+1 ), d +c + Space. (i h < 01x0 >)} 

e e ^e Q 

k+1 

£ raax{log 9 h(e_01xO ), d + c + c 

e o e o . . 

,,h(e_01xO *K , 

S d + c + c + S (h(e n 01xO k+2 )) 
u 

< S 2 (h(e 01xO k+1 )) 

(because x is so long) 

» i h < e o olxok+1 > € Loy) 



^(OlxoS 



€ L(M') 



€ L(M ) . n 

e o 

Finally, M' can be modified to use its finite-state control to re- 

e o 

ject padded inputs (those of even length) and to satisfy the claim for 
short ones without using the work tape. If le fl « bin( j) , then this gives 
an off-line TM that accepts {1 | x € L, lx = bin(i)} within space 
S^.S^.l^Oll 11 )) € 0(S 2 (3 J .h(011 n ))). From this it is easy to derive a 
fixed recursive space bound S, for which L € NSFACE(S~). Since L is an 
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arbitrary recursive language over {1}, this contradicts Lemma 16. 
As in Theorem 18, a similar proof works for DSPACE. \J 

Corollary 28 . Let S 2 , S be fully construe table; and let f(n) € 0(n)-0(l) 
be nondecreasing and linear space honest. There are languages over {1] 
that bear witness to the following proper containments: 
(i) (J {DSPACECS^j S t € o(S 2 )} g DSPACE (S 2 ) , 

U {NSPACECSj)! S t 2 € o(S 2 )} £ DSPACE(S 2 ) 

whenever log n € o(S 2 (n)). 
(ii) (J {NSPACECS^I S 1 <n 4- f(n)) € o(S 2 <n)) , S^n) € 0<S. 2 (n))} 

5NSPACE(S 2 ) 

whenever log n € o(S 2 (n)). 

(iii) U {NSPACECS^I S 1 (2n) € 0(S 2 (n)), S 1 (n) € o(S 2 (n))} £ NSPACE(S 2 ) , 

U [DSPACECS^I S t (2n) € 0(S 2 (n)), S^n) € o(S 2 (n))} £ DSPACE(S 2 ) 

Whenever 1 € o(S 2 (n)). 

(iv) DSPACE(S,m) 5 DSPACE(S) 

whenever 1 € o(S(n)). 

(v) NSPACE(S.m) a NSPACE(S) 

whenever log n € o(S(n)), 

S(n + f(n)) € 0(S(n)). 

(vi) NSPACE(S.m) g NSPACE(S) 

whenever 1 € o(S(n)), 

+ The technique of [MM71] can be used to show that each of the fol- 
lowing set differences contains a language over a one- letter alphabet if 
S„ is fully cons true table: 

DSPACE(S 2 ) -U (DSPACECspl S ± fully constructable, S 2 4 0(8^}, 
DSPACE(S 2 ) - U {NSPACE(S 1 )| Sj^ fully constructable, S 2 I 0(S 1 )}. 
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S(2n) € 0(S(n)). 
(vii) NSPACE(S,m> e NSPACE (S,m+l,l) , 
DSPACE(S,m) g DSPACE(S,m+l,l) 
whenever log n € o(S(n)), 

S(n + f(n)) - S(n) 6 o(S(n)), 
m is sufficiently large. 
(If S is fully cons true table by an (m,l) -machine, then m is suffi- 
ciently large; if S is actually linear space honest, then m = 2 is 
sufficiently large.) 
(viii) NSPACE (S ,m) g NSPACE (S ,0+1 , 1) , 
DSPACE(S,m) g DSPACE(S,m+l,l) 
whenever 1 € o(S(n)), 

S(2n)-S(n) € o(S(n)), 
m is sufficiently large. 
(If S is fully constructable by an (m,l) -machine, then m is suffi- 
ciently large.) 
(ix) NSPACE(S,m,j0 gNSPACE(S,m) for all i, 
DSPACE(S,m,je) g DSPACE(S,m) for all t 
whenever log n € 0(log S(n)), 

S(n + f(n)) - S(n) £ 0(log S(n)), 
m is sufficiently large. 
(If S is fully constructable by an (m, I) -machine, then m is suffi- 
ciently large; if S is actually linear space honest, then m = 2 is 
sufficiently large.) 
(x) NSPACE (6 -S, 2,1) c NSPACE (8 -S, 2) for all |, 
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DSPACE<6»S,2,jD 5 DSPACE(6.S,2) for all A 
whenever 1 € o(S(n)), 

S(2n)-S(n) € 0(log S(n)), 

6 is rational and sufficiently large. 
(If 8»S is fully constructable by a (2 , 1) -machine and 
1 € o(8.S(n) - log n), then 5 is sufficiently large.) 

Proof , (i) Use Theorem 25. (See Corollary 19(ii).) 

(ii) Use Theorem 26. (See Corollary 19(iii).) 

(iii) Use Theorem 27. (See Corollary 19(iii)-> 

(iv) Use Theorem 25. (See Corollary 20(ii).) 

(v) Use Theorem 26. (See Corollary 20(iii).) 

(vi) Use Theorem 27. (See Corollary 20(iii).) 

(vii) Use Theorem 26. (See Corollary 23(i).) 

(viii) Use Theorem 27. (See Corollary 23<i).) 

We explicitly prove parts (ix) , (x) to show just how few additional 
worktape heads can increase the power to accept languages over a one- 
letter alphabet. * 

(ix) Take m so large that S is fully constructable by an (m,l)- 
machine, and look at any jfc. Take k so large that 

4.1oe n + S(n + f(n)) - S(n) i k-log^ S(n). 
Since S + k.log, S is fully constructable by an (m, 3) -machine, Theorem 
26 gives a language over {1} that bears witness to the proper contain- 
ment in 

NSPACE(S,m,i) g NSPACE(S +k.log ffl S, m, X+6) 
C NSPACE(S,m,Hk49) 
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CNSPACE(S»a)* 
the proof for DSPACS 1* Identical. t ((u)^o ? I 

(x) Take rational 6 ao large tfaat(*** §«/ialV(*?»**W< : * ble by a 
(2,l)-««chlne and S'3(n) ^km^^smmillhmmk^h ki H tiU^ d-b Look •* 
any A % 3* **«* fc > » : ad la***, Cba* M»*ll3h4fe&^ n**2 ^<*>* - 
Since 6*s + (lcj^U^Io^ »^ta.fally K raJ ii »ri ia litAl| i^^ia, |)i^^^*« > : 



'T'W^i 




■ c 



A. proof for D6PACE t^ffffff^J,.^ ^ ^ ^^ ^ { ^ 

S(iH-i)-S(n) € o<8(n)) of M«^>rf^a> €cO«t^lft^ «u^N l gi ! *§«# ?f»#f^ 
cr*arta*2MNi U*e*r •**•* nono^ ffl^t^i f t a ^^fl jfra ^q ^. »»^ , uV 
s(n + M*)>- S<n) €,o#^y «* gx*,+ ^^ - ,.< . . 

raap a c tiyoly. c ' ,33d£r!ql& '-jsiusJ 

for space boun d * below lo#ta> (#|i^.l«JiiM|NMM9 l MSfeff' llitylllfstasro 

we can exhibit a nonraajrtac Ja*!***** ng>r4 »)„ % J p fwr*JtfMft l&gjfe Tha 
lasanamesia laat|ilf-|£#i|b)s«^M>lMNfr^^«ri:js£ro^ v-IIwl' si 8 «of** -*- £ &.-:-«.i. :: . 
- f (g) * Mlelfcl ii ia aa»fc diirinible by jjfo Til *•«» ^s^a*--; 
A - {n| f(a) la a powr of 2}. ; Ti 

(A. Meyer point* out that Jv HartpaaO# » a a i , —WifaH W f « ajpj^y y4jM^Mr 
exauple in- a private 1 1— ewiti ■tioa t*M**a»; ^r, j|| Minn Iji for 1 cam be 
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obtained from the deterministic off-line TM that fully constructs the 
space bound of Proposition 7(iv), so L € DSPACE(log log n). To prove 
L nonregular, it certainly suffices to find a positive integer n for 
each prime p > 2 , such that 

A n [m«n | 1 £ m < p} ■ « $ ^ A fl {m»n | lira}. 

Just take n to be the least common multiple of the positive integers 

k k k+1 
not exceeding 2 , where 2 < p < 2 . For 1 £ m < p, then, 

2 k < f(m.n ) * p < 2 k+1 , 

so that m*n 4 A. Yet, the least common multiple of tbe positive inte- 

k+1 
gers smaller than 2 is a multiple of n that does belong to A. 

Examples . There are languages over a one- letter alphabet that bear wit- 
ness to the following proper containments: 

NSPACE(2 n /log* n) g NSPACE(2 n ) (part (ii) with f(n) = log* log* n). 
U (NSPACE(S)| S(n) € o(log n)} g N SPACE (log n) (minimum example of 

part (iii)). 
DSPAGE(2 n ,m) g DSPACE(2 n ) (part (iv)) 
NSPACE(n 8 ' 13 /(log 2 21 n) 5,6 , m) g NSPACE(n 8,13 /(log 2 n n) 5 ' 6 , m+1, 1) 

(part (vii)). 
NSPACE((log 2 21 n) 5,6 , m) C NSPACE((log2 n n) 5 * 6 , m+1, 1) 

(part (vii) or part (viii)). 

* / * 

NSPACE(2 n ' log n , m) g NSPACE(2 n/log n , m+1, 1) (near-maximum 

* * 

example of part (vii) ; f (n) » log log n) . 
NSPACE(n 1/6 ,m,i) Q NSPACE(n 1/8 ,m,je+L4.6j+10)for every rational pi 
(proof of part (ix)). 

* * 

NSPACE(n.log 2 n/log n, m, I) g NSPACE(n»log 2 n/log n, m, A+13) 
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(near-maximum example of part (ix)). 
NSPACE(log 2 n, 2 k , t) q NSPACEUogj n, 2 k , i+5) for every 1 2s 3 

(proof of part (x)). 
NSPACE((log 2 n)(log 2 log 2 n) , 2 k , t) 5 NSPAGE((log 2 n)(log 2 log 2 n) , 

2 , 146) for every jt 2 3 (near-maximum example of pert (x)). 

Corollary 29 . Each of the following set differences contains a language 
over a one-letter alphabet: 

NHEADS(k+5) - NHEADS(k), 

DHEADS(k+5) - DHEADS(k). 

Proof . Corollary 28 gives a language over { 1} that bears witness to the 
proper containment in 

NHEADS(k) c NSPACE(log 2 n, 2 k , 1) (by Lemma 21) 

5 NSPACE(log 2 n, 2 k , 6) 

k+1 
cNSPACE(log 2 n, 2* , 1) 

c NHEADS(k+5) (by Lemma 21). 

The argument for DHEADS is identical. D 
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10. Open questions 

Our most general open questions, of course, concern necessary and 
sufficient conditions for containment and separation among the 
NSPACE(S,m,j0, DSPACE(S,m,j&) complexity classes. 

1. For containment we ask in particular how close the truth comes to 

the "ideal" result 

S 9 (n) t„ S,<n) jL 

m 2 Z .S 2 (n) Z e 0^ •S 1 (n) L ) =» 

NSPACE(S 2 ,» 2 , i 2 ) C DSPACECSj .mj , jtp . 

This very strong statement would immediately yield and perfect all 

the results of Section 2. It would also yield NSPACE(S,m,jD = 

DSPACE(S,m,X) , however, so it seems extremely likely that the truth 

stops somewhat short of the statement. 

2. For separation we ask how close the truth comes to the "ideal" result 
that, for S- fully cons true table, there must be a language in 

DSPACE(S 2 ,m 2 ,jt 2 ) - U {NSPACE(S l ,m 1 ,l 1 )| 

S,(n) jfc„ S (n) A 
m 2 Z .S 2 (n) L 4 00^ L »S 1 (n) L )}. 

This very strong statement would immediately yield and perfect all 

the separation results of Section 4. 

3. Lemma 21 illustrates the relationship between additional input heads 
and additional space log n. If we consider a model that has k 2: 1 



read-only heads on its input tape, then the open statements above 
could be rephrased in terms of quantities of the form m »S(n) »r 
rather than just m ' n ^»S(n) . Then they would include and perfect 
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also Lemma 21, Corollary 22, and the work of [Ib72], 

The following specific instances of the above questions are just 
beyond the frontier of our knowledge: 

4. DSPACE(n,2,l) - DSPACE(n/log 2 3, 3, 1)? Proposition 3 comes close 
to an affirmative answer. 

5. DSPACE(n,2,l) ■ DSPACE(n - log 2 n, 2, 2)? Propositions 4, 5 come 
close to an affirmative answer. 

6. NSPACE(log n) c DSPACE((log n) /log* n)? Proposition 6 Comes close 
to an affirmative answer. 

7. NSPACE(S,m,i) - DSPACE(S,m,A)? Everybody expects a negative answer, 
but our study offers no clear and convincing evidence for one. A 
negative answer to any of open questions 8, 9, 10, 11, 19, 20 would 
do, though. 

8. DSPACE(log n) <£NSPACE((log 2 n)/2, 2, 1)? Theorem 8 comes close to 

an affirmative answer; e. g. , DSPACE (log n) <t !BPACEC{log 2 n)/3, 2, 1), 

9. DSPACE((log n)(log* n)) <t NSPACE(log n)? Corollary 19(i) comes 
close to an affirmative answer. 

2 n 2 n+l # 

10. NSPACE(2 ) cNSPACE(2 /log n)? Corollary 19(iii) comes close 

to an affirmative answer, and Corollary 19(ii) gives an affirmative 
answer for the DSPACE analogue. 

11. NSPACE((log* n) n , 2, 1) 5 NSPACE((log* n) n )? Corollary 20(iii) 
comes close to an affirmative answer, and Corollary 20(ii) gives 
an affirmative answer for the DSPACE analogue. 
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12. DSPACE(log. n, 2, 1) c DHEADS(4)? Lemma 21 comes close to an 
affirmative answer. 

13. MEADS (k) g DHEADS(k+l)? 

14. DHEADS(k+l) <£ NHEADS(k)? For the particular case k ■ 2, we suspect 

2 k 
that {l n | k e N, n = 2 } $. NHEADS(2), but the suspicion does not 

generalize. 

15. DSPACE(2 n ,m) g DSPACE(2 n ,m+l)? Corollaries 20, 23(ii) both come 
close to an affirmative answer. 

16. DSPACE(n(log 2 n)(log*n), 2, 1) g DSPACE(h(log 2 n) (log* n) , 2)? 
Corollary 24(11) comes close to an affirmative answer. 

17. DSPACE(log 2 n, 2, 1) 5 DSPACE(log 2 n, 2, 5)? The proof of Corollary 
24 (ii) comes close to an affirmative answer. 

1/2 
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DSPACE(n - (log 2 n) ' , 2, 1) g DSPACE(n,2,l)? 



2 n+l 2 n 

19. Does NSPACE(2 ) - NSPACE(2 ) contain a language over a one- 
letter alphabet? Corollary 28 (ii) comes close to an affirmative 
answer. 

20. Does NSPACE(2 n ) - NSPACE(2 n ,2,l) contain a language over a one- 
letter alphabet? Corollary 28(v) comes close to an affirmative 
answer. 

21. Does DSPACE(n.log 2 n, 2) - DSPACE(n*log 2 n, 2, 1) contain a language 
over a one- letter alphabet? Corollary 28 (ix) comes close to an 
affirmative answer. 
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22. Does DSPACE((log 2 n) 2 , 2) - DSPACE((log 2 n) , 2, I) contain a lan- 
guage over a one- letter alphabet ? Corollary 28(x) comes close to 
an affirmative answer. 

23. Does DHEADS(k+2) - DHEADS(k) contain a language over a one- letter 
alphabet? 

Finally, we list a few miscellaneous open questions. 

24. Is there a hierarchy of languages over {1} for space bounds below 
log n? 

25. For S fully constructable by an (m,A)-machine and U Q the universal 
simulator of Condition 2 for m, jt, is there any language in 
NSPACE(S,m,i+l) that requires more space (on an (m,|+l) -machine) 



than the S-cutoff of U Q ? 



1M 



26. Even if L € NSPACE(S 2 ) - NSPACE^) , there may be an off-line 
that accepts infinitely many strings x € L within space S^xl). 
When can we find an infinite language L € NSPACE(S 2 ) such that 
every off-line TM that accepts L requires more than space SjCjxl) 
on ill JjHt finitely many strings xflt 

27. Is there some conceptually simple language in U {NHEADS(k)| kj 1} 
or U {DHEADS(k)| k a 1} which is not in NHEADS(k) or DHEADS(k) for 
any small k (say k - 3)? If, for X a matrix of strings over {0,1}, 
we define 

r(X) « row- wise concatenation of X, 
c(X) * column-wise concatenation of X, 
then some good candidates are 
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{r(X)c(X)| X is a k x 2 matrix}, 
[r(X)c(X)| X is a k x 2 matrix for some k} , 
{r(X)c(X)| X is a k x k matrix}, 
[r(X)c(X)| X is a k x k matrix for some k}. 
What are the complexities of these languages? 

28. If S is fully constructable by an (m,jj) -machine, does 

log n - a-l).log log n - S(n) £ 0(1) 

m mm 

necessarily hold? Proposition 7(v) comes close to an affirmative 
answer. 
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APFEKJKX I 

Diagonal izetiou is a technique fof com^rwtii»g * lan^ajse that is 
not in some given class. If the members oJ tb^ class can he described 
by character strings, then the attest diag^i#l construction includes 
the string x just if the language described by, that , str;MMI does not in- 
clude x. A useful variant on this idea is to include xy iff the language 
described by its pref ix x does not. 

To diagonalize over a complexity class, a good a^foach is to de- 
scribe languages by encoding the programs of the resourcexbounded auto- 
mata that accept them. Then the construction, ca» be perforated by em- 
ploying a "universal simulator" that can simulate any automaton from its 
program code. The simulation can then be examined, with disagreement in 
mind, to decide whether or not it leads to acceptance. 

Because we shall be interested also in an unjgex bound on the com- 
plexity of the diagonal language* we will want the construction to be 
effective and as efficient as possible. This calls for an efficient 
universal simulator. To diagonalize over DTI*C&(X>, we can use the uni- 
versal simulation technique of Hennie and Stearns [HeS<»6] to simulate t 
steps of the deterministic TM acceptor with program code e by c e «t»log t 
steps of the simulator, where the constant c depends only on e. The 
diagonalization technique used by Hartmanis and Stearns [HaS65] then 
shows that DTIME(T 2 ) - DTIMS<T.) is nonempty whenever T 2 is a running 
time and T 2 i 0(T, log Tj). For further details, see [HaS65}, [HeS66], 
[Con73], and the sketch below of a nondetenainistic diagonalization over 
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DTIMECL,) . 

For nonde termini s tic TM acceptors, we can use the technique of Book, 
Greibach, and Wegbreit [BGW70] (Lemma 8 of Chapter Two of this thesis) to 
get a more efficient universal simulation. (Doing so requires that their 
technique be effective, and it is.) In the following proposition, we use 
the details of this simulation in a diagonal construction in the style of 
[HaS65], [HeS66]. 

Proposition . If T 2 is a running time with T 2 4. O(T-), then 
NTIME(T 2 ) - DTIMECr.) 4 <&. 

Proof sketch . (We assume familiarity with the proof sketch in Chapter 

Two of Lemma 8.) We construct a TM acceptor M that diagonalizes over 

DHME(T.) within time bound T 2 < Given an input ex (with e a program 

code) , M performs the (nonde terminis tic) Lemma 8 simulation of M on ex 

e 

and simultaneously operates clocks for the running times T 2 /2 and T 2 - 
Recall that the simulation involves guessing a sequence of displays and 
actions and then checking it (deterministically) for one of three out- 
comes: 

not a legal computation, 

legal computation without acceptance, 

legal computation with acceptance. 
If the outcome is the second one and that fact is discovered after t 
steps by M, where T 2 (Jex|)/2 £ t i T 2 (jex|), then M accepts ex. There 
is no other way for M to accept. 

Now suppose M deterministically accepts L(M) within time T. for 
some particular program code e. Without loss of generality, assume that 
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M halts only when it accepts. There is some constant c such that M 

will get through computations of length t by *i within c t of its own 

e 
it 

steps. Since T 2 4 00^) , we can take x € {0.1} so that 
c.T. (| ex| ) < T 2 (| ex| )/2. If M deterministically accepts ex, then it 
does so within T. (| ex| ) steps, and there can be no longer legal computa- 
tion. By design, then, ex € L(M e ) implies ex i L(M). If M g does not 
accept ex, then there is a legal computation of every length; therefore, 
ex 4 L(M ) implies ex € L(M). The contradiction establishes 
L(M) 4 DTIMECTj). D 

To diagonalize over NTIME(T) is more difficult. The problem is 
that discovering that M does not accept ex within t steps seems to re- 
quire examining all legal lines of simulated computation up to t steps. 
This is a deterministic process which apparently may take exponentially 
longer than simulating a single legal line, so the diagonal construction 
yields DTIME(T 2 ) - NTTME(T-) / whenever T 2 is a running time and 
log T 2 4 0(T X ). 

None of the above diagonal constructions actually depends on T-, 
and they all produce languages over {0,1}; so Theorem 1 of Chapter Two 
summarizes the results. 

A technicality rules out such strong separation results for lan- 
guages over a one- letter alphabet. Suppose, for example, that T 2 is a 
running time with n log n € o(T 2 <n)) and that L € OTIME(T 2 ) is a lan- 
guage over just {1}. If the complement of L is finite,, then L is regu- 
lar and L 6 DTIME(n). If the complement of L is infinite, on the other 
hand, then our convention that only acceptance time matters guarantees 
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that L € DTIMECM for 
C 2 



T 9 (n), if l n e L; 



T.(n) ■ 

1 n, if l n « L. 

In either case, L €U (DTIME^)] T 2 4 0($ x log T )}. 

Strengthening the "lim inf" condition on T- (e. g. , T 2 4 0(1. log TL)) 
to a "lim" condition (e. g. , T- log T. € o{T 2 )) is one way to get sepa- 
ration results for languages over a one-letter alphabet. A diagonal 
language over {1} can then be constructed by trying to differ on input 
1 from M f , . , where f(n) is obtained from, say, the binary representa- 
tion of the exponent of 2 in the prime factorization of n. The results 
are given by Theorem 2 of Chapter Two. 

As far as we know, diagonalization alone yields no results better 
than those of Theorems 1, 2 of Chapter Two for TM acceptance time com- 
plexity. If we change our definition to take into account the time 
spent in nonaccepting computations, however, then we can use the dia- 
gonal technique of [MM71] to get by with "lim inf" conditions in Theorem 
2. I. e. , for 

NTIME'CT) = {L| L is accepted by some TM that never computes for 
more than T(n) steps on an input of length n}, 

DTIME'CT) = {LJ L is accepted by some deterministic TM that never 
computes for more than T(n) steps on an input of 
length n) , 
the set differences 

DTIME'Orp - (J (KHME'CTpl T 2 4 0(Tj_ log T^}, 

NTIME'(T 2 ) -U {DTIME'erpI T^OC^)}, 
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DTIME'(T 2 ) - U {NTIME , (T 1 )| log T 2 4 0(1^)} 
do contain languages over a one-letter alphabet if T„ is a running time. 
For T a running time, we clearly have 

NTIME(T) =NTIME'(T), 

DTIME(T) =DTIME I (T), 
so we do get languages over {1} in the set differences of Theorem 1 of 
Chapter Two if we insist that the unions range only over running times 

V 



119 



Let L 

p.c. 

[program] 

[Instruction] 



APPENDIX II 
A PROGRAM CODING FOR CHAPTER TWO 

= [program], where 

= begin program [Instruction] end program 
= begin Instruction [requirement] 

[rewrite] 
[shifts] 
[next] end instruction 

+ begin instruction accept end instruction 

k 
[requirement] = begin requirement [symbol] end requirement 

k 
[rewrite] = begin rewrite [symbol] end rewrite 

[ symbol ] = begin symbol tally end symbol 

[shifts] 

[next] = begin next [ins true, no.] end next 

[ins true, no.] = begin ins true, no. tally end ins true, no. 



begin shifts (left + right + still) end shifts 



begin 


program 


begin 


instruction 


begin 


requirement 


begin 


rewrite 


begin 


symbol 


begin 


shifts 


begin 


next 


begin 


ins true. no. 


accept 





= 00001 

- 00011 
•- 00101 

= 00111 
= 01001 

- 01011 

- 01101 
= 01111 
= 10001 



end program = 00010 

end instruction - 00100 

end requirement = 00110 

end rewrite = 01000 

end symbol = 01010 

end shifts = 01100 

end next = OHIO 

end instruc. no. = 10000 

tally = 10010 
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SOME MORE CORRECTIONS TO MAC TR-137 
Joel I. Self eras 
December 30, 197 1 * 

p. 9: Delete the six lines following the statement of Corollary 15. 
pp. 33-3^: Delete starting with the fourth word of line 9 from the 

bottom of p. 33 through line 10 of p. 3^. 
p. 35, line lU: Change "- 1" to "+l". 
p. 35, line 15: Change "f (1) " to 'f(l) + 2". 
p. 35, lines l6, 20: Change "f (n) -ta-1 " to "fCnJ-to+l". 
p. 35, line 22: Change this line to 

•f(n) + r f 1 (f(n)) =f(n) +n 

< f (n) + n + 1 

< (f(n)+l) + (n+1) 

r- — 1 

= (f(n)+l) + f'VWft),". 
p. 36: Delete the first three lines, 
p. 37, line 5: Change % (x) *' to "Time^ (x) ". 



